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E UNIVERSITY OF GEORGIA 
DEPARTMENT OF MATHEMATICS 
GRADUATE STUDIES BUILDING 
ATHENS, GEORGIA 30602 


January 5, 1973 


Office of Grants § Research Contracts 
National Aeronautics £ Space Administration 
600 Independence Avenue 
Washington, D. C. 


(ATTN: CODE SC) 


Dear Sir: 

Attached is a final report on work accomplished including reprints of 
journal publications and some preprints. As a result of two years of 
N.A.S.A. support, I have 10 published journal papers, 6 published abstracts, 
1 published technical report (and doctoral dissertation), 2 journal papers 
which were submitted but not yet published at the expiration of the grant, 
and several journal papers and one dissertation almost completed at the 
expiration of the grant - all of which carry (or will carry) acknowledge- 
ment of N.A.S.A. research support. (Listing follows.) 

We have developed a useful analytic method and a very versatile and powerful 
new computer technique for solving stochastic differential equations. We 
recently computed some 14,000 terms for a series representing the solution 
process of such an equation for our methods and other existing methods of 
solution to compare results and errors involved - which show unequivocally 
that we have achieved extremely important results because of your support. 

I regret this work was not yet in a form to send to you with this letter 
and final report although an earlier preliminary discussion was included. 

The completed work will become a dissertation in June, 1973, and will then 
be published with appropriate acknowledgement to N.A.S.A. 

I, of course, regret the termination of N.A.S.A. support'since we clearly 
have results which will be of value to N.A.S.A. and to other agencies as 
well. Our work will tie in closely with the work of M.M.R. Williams on 
kinetics of nuclear reactors, with the work of Klimontovich on plasmas, 
to stochastic control, weather prediction, and several other areas. In 
view of results achieved and under way, I hope N.A.S.A. will again be 
involved with my group in the future. You will also be pleased to know 
the U.S.S.R. Academy of Sciences new Merguelian Institute of Applied 
Mathematics in Erevan, U.S.S.R., has asked to send postdoctorate researchers 
to work with us on the new methods and several professors wish to come to 
Georgia to work with us. 
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I would like to express my appreciation to N.A.S.A. for its essential 
support of this research and for its accomplishments for the U.S. in 
space. With best wishes for your continued success. 


Sincerely, 



George Adomian 
Professor of Mathematics 


Conies to: 

A- 

Office of University Affairs (Code Y) 

Mr. J. Albus (Code RET), Data Systems Branch 
Mr. Joseph T. Davis, Grants Officer 

Dr. Samuel A, Rosenfeld, former Project Officer for Grant (Please Forward) 
Dr. Raymond Wilson, former head of Applied Mathematics (Please Forward) 
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BOUNDEDNESS OF ABSOLUTE VALUES OF 
GENERALIZED FOURIER COEFFICIENTS 


by 


Charles C. Miao and G. Adcunian 
University pf Georgia 
Athens, Georgia 30601 



ABSTRACT 


For f(x) e C[a,b] and {<^(x)} an orthogonal 

set with weight function w(x) on [a,b] , an upper 
n i 

bound for S ^k' a k ^ where a k are generalized 

k=0 

Fourier coefficients is given for odd n by 
b i 

Jn+1 ( j’ w (x)dx) 2 |tf H where ||f|] is the sup norm of f 
a 

on [a,b]. 

For even n , the bound is 

[(n+2)(J w(x)dxjlfl| 2 - max (^+1 ) 1^, <^) ^a fc | 2 for 
a k 

0 £ k £ n , which is a little cumbersome so the result 

for odd n would be more useful. 

For the trigonometric case f e C[-ff, tf] and 

w(x) = 1 , this result gives 2 |a k | + |b k 1 £ 2Vn+l ||f|| 

k=0 


for any n . 



Given f(x) e C[a,b] and letting {<£>} be an 

orthogonal set of continuous functions with weight 
function w(x) on [a,b] , consider the generalized 
Fourier series Ea^^Cx) converging uniformly to 
f (x) . 

The normalized Fourier coefficients are given by 

b b 2 

a k = (f , <^) * J w(x)f(x)<^(x)dx/J* w(x)<^ (x)dx 

a a 

By Bessel's inequality, 

2 * I w(x)f 2 (x)dx £ (J w(x)dx)!|f|| 2 

k=0 a a 

where f is the sup norm or maximum of f in [a,b] . 

A 

Denote a k by A k ar *d write 

n b 

S l A k I 2 * w (x) dx) || f || 2 . 
k=0 a 

Suppose n is odd. We separate the left side into 
pairs thus 

(n-l)/2 9 9 b 9 

£ l A 2k' + l A 2k+l! 2 £ (J «(x)dx||f S| 2 • 

We let the sequence { |Ag k | + ! A 2k+l I be a 

rearrangement of the sequence { | + | A 2 k+ i | 

k=0 

such that ! A 2 k I + ! A 2k+l 1 * ^ A 2(k+1) + A 2(k+l)+ll 


i.e., each pair is greater or equal to the next pair, 



2 


e.g., A q + ^ a£ + A^ , A 2 + A 3 2 A 4 + A 5 * etC ' 

Now using Tchbychev's inequality, we write 


(n-l)/2 
( E 
k=0 



+ 


l A 2k+l 






+ 1 ) 


(n-l)/2 

£ <K k 

k-0 


|An 


2k+l 



£ 2 (- 


n-1 


+ 1 ) 


(n 


l)/2 

E 

k=0 


‘2k 


A 


2k+l 


Since sums are preserved 


(n-l)/2 

( k5l ^ 2k ^ 2k+1 





(n~l)/2 9 

(n+1) E l A ot l + 
k=0 


l A 


2k+l 


or simply, 

( E |A.|) 2 * (n+1) E |A | 2 (2) 

k=0 K k=0 K 

Combining (1) and (2) 

( E | A. |) 2 £ (n+1) (J\w(x)dx) ||f || 2 
k=0 K a 

hence our result 

£ I V^)^ a k I 5 */n+l(J w(x)dx)%f || * (3) 

If n is even we can let A , = O to divide 

n + 1 

into pairs as before, or somewhat more generally since 

zero can be inserted anywhere in the sequence, let 

O ^ j £ n and let [A'} n+1 be a rearrangement of 

s s=0 
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{O.A ,A,,...,A 1 such that 

O t 4 

(i) l A 2s I + l A 2s+l I * l A 2(s+l)l 

(ii) The zero is paired with the 


+ l A 2(s+l) + l' 


We now have pairs as before and again using Tchbychev's 
inequality, we have 
n/2 9 

( S J A i s l + l A 2 S+ li> S 

s^O 

2(S ♦ 1>“bW| 2 + |A^ S+1 | 2 - (§ + DA 2 . 
k-0 o 

Since the suras above are preserved, 

( £ |A,|) 2 £ (n+2) ( £ |A k | 2 ) - (£ + DA. 2 . 
k=0 k=0 J o 

Combining (1) and (4) (for 0 ^ j ^ n ) 

tl 

( £ A, ) 2 £ (n+2) ( J w (x)dx) ||f i| 2 - (§ + 1)A. 2 . 
k=0 k a 2 J o 


Finally (for even n ) 

£ |(<n * /(n+2)(J b w(x)dx||f!| 2 ) - <§ + 1)A, 2 (5) 

k=0 a J o 

where 0 £ j £ n . 

° b i 

(If A. =0 the right side becomes f(n+2)(J w(x)d*) ] *||f || 
J o a 


which is not as tight a bound.) Thus the lowest bound 



(not l.u. b. ) is 


[ (n+2) ( J w (x)dx||f 1| 2 ) - max(^-l) I (cp^, cp k )^a fc | 2 ]^ (6) 

a k 

where 0 £ k £ n . 

Example : Trigonometric series for f(x) e ir] 

a 50 

f (x) * -ijp + £ cos kx + b, sin kx 

k=l K K 


w(x) = 1 

-f 


2" if k = 0 
s ff if k ^ 0 


By (1), 


n 


(2t r)(-^) + 2a fc 2 + b k 2 s 2ff||f H" 
k= 1 


or 


r 2 . h 2 
£ a, + 

k=0 K 


x s 2 H f ii 2 


a result also apparent from Parseval’s formula 

_ 2 


i J (f (x) | 2 dx - ~y + £ h k 2 + b 


k~l 


or 


11 2 2 
SA + b k 

k=0 


a Ti ^ o 

- « 4 I If (x) I 

- Iff 
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By (2) , we have 

( S |a. | + |b k |) 2 s 2 <n+l) B |a | 2 + |b | 2 -(n+l>a 2 . 
k =0 k k k -0 k k 

Combining, we have 

S |a | + |b J £ 2^1 ||f|| . 
k =0 K K 

Cheney* - gives the bound nJ2n~\ ||f|[ . It's easy 
to see 2 */n-l ||f|l < flV 2 n-l ||f|| for all n ^ 1 . 

As an elementary example let f(x) = n in 
[-jn ttJ • We get immediately 

f (x) = 2 (sin x - g + 3 “ • • • ) • For the sum 

3 

£ |a, | + |b,| , the bound stated here is 4ff , which 
k =0 

is quite close to the actual sum, while Cheney*s bound 
is ir^ . 

Acknowledgement: This work has been supported by the 

National Aeronautics and Space Administration 
(NGR 11-003-020). 
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A Decomposition for Some Operators 

by 

Bernard B. Morrel 

Let H be a complex Hilbert space and let /5(H) 

denote the algebra of all bounded linear operators on H . 

Then T e /5(H) is abnormal (sometimes, completely non-normal) 

if there is no non-trivial subspace M H which reduces 

T and such that the restriction of T to M is normal, f. 

Every T e 5(H) may be written uniquely as the direct sum 

of a normal operator T q with an abnormal operator . 

We shall refer to T and T, as the normal and abnormal 

o I 

parts of T , respectively. 

A theorem of von Neumann ([7], p. 96) asserts that every 
isometry V on a Hilbert space H is unitarily equivalent 
to the direct sum of a unitary operator and a pure isometry 
of multiplicity d = dim [(VH)' L ] (cf. [3], problem 118). 

It develops that the scalar d is a complete set of 
unitary invariants for the abnormal part of the isometry V .. 

if 

An operator T is quasinormal if T commutes with T T . 

In particular, every isometry is quasinormal. In [1], 

Brown obtains both a canonical form and a complete set 
of unitary invariants for the abnormal part of a quasinormal 
operator. In the isometric case, Brown's results specialize 
to those of von Neumann. 
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In section 1 of this paper we obtain a decomposition 
for operators, which, as is shown in section 3, is a 
generalization of Brown's work on quasinormal operators. 

We associate with each T e /3(H) a (not necessarily 
proper) subspace H-^(T) of H which is invariant under 
T* and reduces [T] = T*T - TT* . If V e /9(H) is 
isometric, for instancy, one has H^(V) = (VH) ± . We 
establish that the structure of the abnormal part of T 
is completely determined up to unitary equivalence by the 
restrictions of T* and [T] to H^(T) . In case 
d = dim (H^(T)) < * , the structure of the abnormal part 
of T is determined by two d-by-d matrices. 

The results of section 1 are of little interest if 
H^ (T) is too large. In section 2 we study conditions 
under which H^(T) = H . We show that if T is abnormal 
and nearly a finite-dimensional operator (in some appropriate 
sense), then H-^T) = H . This suggests that the results 
of section 1 will be of most interest if the operator being 
studied is far from being finite-dimensional. 

The main result of section 3 is that if T is sub- 
normal, then H- L (T) is the closure of the range of [T] . 
This means, for example, that the structure results given 
in section 1 may be easily applied to subnormal operators 
whose self-commutator is of finite rank. It also enables 
us to deduce the results of Brown and von Neumann mentioned 
above from our results in section 1. 
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In section 4 we give an application of our results to 
the study of quasi trangular operators. 

The author would like to express his thanks to 
P.R. Halmos, T.L. Kriete, III, and to Marvin Rosenblum 
for a number of helpful conversations concerning the results 
in this paper. 


§1. We begin with several lemmas which may be of interest 
independent of their application here. 

LEMMA 1.1 : Let H be a Hilbert space and let A,B e /?(H) . 

CO 

Then M = ker (AB S - B S A ) is the largest subspace of 

s=l 

H for which BM M and ABv = BAv for every v e M . 

PROOF : It is clear that M is a subspace of H . Pick 
v e M and let w = Bv . Then for all integers s ^ 1 
we have AB S w - AB S+1 v = B S+1 Av = B s (BAv) = B^ (ABv) = B S Aw , 
since v e M . Hence BM C_M . The relation 
M c^ker(AB - BA) implies that ABv = BAv for all v e M . 

Next, let Y be a subspace of H such that BY £Y 
and ABy = BAy for all y e Y . Then B S Y C_ Y for all 
s * 1 . If y e Y , then AB 2 y - AB (By) - BA (By) - 
B(ABy) = B Ay . By induction, B Ay = AB y for every 

09 

y e Y and all s £ 1 . Hence, Y £_ Oker(AB s - B S A) = M . 

s=l 
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An easy modification of the proof of Lemma 1.1 yields 
a proof of the following result: 

LEMMA 1.. 2 : Let A,B e 0(H) . Then the largest subspace 
M H such that AM £ M , BM £ m and ABv = BAv for 
every v e M is 

M - n n ker(A r B s - B s A r ) . 
r-1 s-1 

Although we shall not use the results in this general- 
ity, we note that Lemmas 1.1 and 1.2 both hold in case the 
underlying space is a Banach space. 

An immediate consequence of Lemma 1.2 and the definition 
of reducing subspace is the following: 

COROLLARY 1.3 : Let T e 0(H) . Then the largest subspace 

H of H which reduces T and such that T |H is normal 
o 1 o 

is 

H = n O ker ( (T*) r T S - T s (T*) r ) . 

° r=l s=l 

Furthermore, T Ih" 1 is abnormal. 

1 o 

Our next lemma is the basis for the subsequent 
decomposition theorems. 

LEMMA 1.4 : Let T e 0(H) . Put M q = H ,and/ for all 

k ^ 1 , define 

M t - (*) Cl ker<(T*) r T s - T s (T*) r ) . 

K r=l s=l x 
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Then 


i.) 

\ — M k+1 

for all k 2 0 

9 

ii . ) 

™k ^ M k 

for all k * 0 , 


iii . ) 

T \ £ M k- 

j for all k 2s 

1 , 

iv. ) 

+ X 1 

T M k CM k 

for all k £ o 

> 

v.) 

™k — M k+1 for a11 k * 

0 . 


PROOF : Parts iv. ) and v . ) of the assertion follow 

immediately from parts ii . ) and iii. ) upon taking orthogonal 

complements, and part i . ) follows directly from the 

definition of the subspaces 

Part ii.) is trivially true if k = 0 . For r ^ 1 , 

00 

Lemma 1.1 implies that ker[(T*) r T s - T s (T*) r ] is an 

s=l 

invariant subspace for T , and hence, so also is M k for 
every k ^ 1 . 

Part iii . ) is trivial if k = 1 , so suppose that 

* 

k ^ 2 . Let x e and put z = T x . Then since 

x e Mj^. C_ M-^ , we have (T*) r T S z = (T*) r (T S T + x) = (T*) r+1 T S x . 
But if r + 1 ^ k , then, since x e M for every p £ k , 

r 

we have (T*p r T s z = T s (T*) r+1 x = T S (T*) r z . Thus 
z e and iii ■ ) holds. 

* * ] 

If we let {e k |k ^ 0} be the standard orthonormal 
o 

basis for & and if we let T be the unilateral shift 
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.2 

on l , then it is instructive to note that 

= sp{ej |j * k} for k * O . 

THEOREM 1.5 : Let T e 5(H) . Then there exists a (finite 

or infinite) sequence {H. |j ^ 0] of pairwise orthogonal 
subspaces of H such that 


i • ) 

H - H © H, 
o 1 

© ... 

® H k 

© . . . . 

ii.) 

H q reduces 

T , 

T|H C 

is normal, and 


is abnormal 

• 



iii . ) 

T*n ± . 




iv.) 

T \ ^- H k-1 

® H k 

for all k ^ 2 . 

v.) 

TH k ^ H k ® 

“k+l 

for all k s 1 . 

vi. ) 

H k ® H k + 1 " 


■™k> 

for all k ^ i 

vii . ) 

dim H k ^ dim H fc+1 

for 

all k £ 1 . 


PROOF : We associate with T the subspaces M, as was 

00 

done in Lemma 1.4. Put H = n k , or, equivalently, 

° k=l K 

H = O D ker ( (T*) r T S - T S (T*) r ) . 
r=l s=l 

From Corollary 1.3, H Q reduces T , T |H q is normal, 
and T I H q is abnormal. 
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Next, define H k = for all k a l . Since 

H = / t M, , we have H x H. for every j > 0 . Noting 

0 k= j k o j 

that H. CM. , for every j a l and that H. C jjt Q , 

J — j-1 l — i — j-1 

whenever i £ j-1 , we conclude that H. x H. if i < j , 

or equivalently, H. x H. if i ^ j . By induction, 

x 3 

M k = H 1 ® H 2 0 * ' • 0 H k * k * 1 , 

It follows immediately that 

H = H © H, © . . . © H, © . . . . 

o 1 k 

Thus, both i . ) and ii ♦ ) hold. 

Part iii . ) follows from Lemma 1.4, since 
T*^ = T*M^ £ = Hj . 

We shall prove iv, ) and v. ) simultaneously. Note 
first that = TM^ £ M 2 = % 0 H 2 . Using Lemma 1.4 

again, we have T*H 2 £T*M 2 = H-^ © H 2 . Also, 

TH 2 £TM^ C_Mg = © H 2 © H 3 . Note that if x x e ^ 

and x 2 e H 2 , then 

<Tx 2 ,Xj> = <x 2 ,T*x 1 > = 0 , 

since T*x^ e . Hence TH 2 £H 2 © and iv. ) and 

v. ) hold in case k = 2.. Suppose that it has been 

shown that TH. C h. © H. ,, and that T*H. C h. , © H. 

3—3 3 + 1 3 — J-1 3 

for all j * m . Then T*H m+1 £T*m£ +1 £ M^ +1 = 

H, © H 0 © . . . © H , , . But if ysH 1 ©...©H,, IJ 

1 ^ m+i ± ju^i 
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then Ty e © . . . © H m , and so, if x e H B+1 , we 

have <y,T*x> = <Ty,x> = 0 . Thus, T*H m+1 £ H m © H m+1 . 

We also have TH m+1 £ TM^ +1 £ M^ +2 -*£©... © H ra+2 . 

If x e H m+1 and y e I£ © . . . © H m , then 

T*y e H 1 © . . . © H ra and <Tx,y> = <x,T*y> - 0 , so that 

TH , C H , © H ... Bv induction, both iv.) and v.) 
m+l — m+i m+^ 

hold. 

Since TH fc £ H k © for every k ^ 1 , we have 

N/{H k ,TH k } £H k © H k+1 for every k ^ 1 . Assume that 

v e H k © H k+1 and that v is orthogonal to N/[H k »TH k } , 

where k £ 1 is fixed. Clearly, v e H k+ ^ . The fact that 

<v,Tx> = 0 for every x e H fe together with v. ) implies 

<v,Tx> = 0 for every x e © . . . © H k . Thus, Tv is 

orthogonal to H 1 © . . . © ; that is, T*v e M k . But 

* 

since v,T v e , we have 

T S (T*) k+1 v = T S (T*) k (T*v) 

- (T*) k T S (T*v) 

- (T*) k (T*T S v) 

- (T*) k+1 T S v 

k+1 “ * * 

for every s ^ l . Hence v e f~\ ker((T ) T - ' T (T )r) 

r=l s=l 

i.e., v e M k+1 . Then v € [ H k+ i 0 M k+ i] “ C°) and 
vi . ) holds. Part vii. ) follows immediately from vi ♦ ) 
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It is worth noting that if T is the unilateral 
shift, then H Q = {0} , while for k * 1 , H k is pre- 
cisely the one-dimensional subspace spanned by e k _^ . 

If T e /0(H) , then we shall use the notation H fc (T) > 
k = 0,1,2,..., to denote the subspaces associated with T 
as in Theorem 1.5. Note that in case H = H Q (T) © H-^T) , 
Theorem 1.5 is nothing more than the decomposition of T 
into a normal and an abnormal part. In case 
H = H q (T) © H-^T) , we shall say that T has a trivial 
decomposition. 

If T e 0(H) is abnormal (so that H q (T) = {0} ) and 
if we let P fc : H ■> H k (T) denote the orthogonal projec- 

tion of H onto H k (T) for k £ 1 , and if we define 

T u - p i T ' H j 

for all i,j ^1 , then T is represented by the matrix 

of operators {T. . } acting on the direct sum of the spaces 

“■ J 

H^ , k 2 : i . Parts iii . ) , iv. ) , and v. ) of Theorem 1.5 

assert that T. . = 0 if either j > 1 or j < i-1 . 

Thus T is represented by a matrix of operators whose 

non-zero (operator) entries lie on either the main diagonal 

or the first subdiagonal of the matrix. To simplify the 

notation, let D. = T. . and let S. = T. . . for every 

1 1 ; 1 1 1 + 1 , 1 

i s 1 . From part vi.) of Theorem 1.5, we have ran S 4 

' 1 

dense in H^^ for i £ 1 , or, equivalently, that 
ker sT = {0} for i s l . 
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In the next two theorems we exhibit a canonical form 
for operators which have a non- trivial decomposition. The 
technique to be used is a modification of the proof of the 
fact that every weighted shift is unitarily equivalent to 
a weighted shift with non- negative weights (cf. [3], problem 
75). Roughly speaking, we wish to show that the matrix of 
operators {T..} described above is unitarily equivalent 
to a matrix of operators of the same form with non-negative 
operator weights along the first subdiagonal. Some 
technical difficulties arise from the fact that the spaces 
{H k } may be of different dimensions. 

For simplicity, we break the reduction to canonical 
form into two parts. 

THEOREM 1.6 : Let T e /9(H) be abnormal. Then there exist 

a (finite or infinite) sequence of Hilbert spaces 

J 1 — J 2 — • • • an ^ corresponding sequences of operators 

D i : J i > J i and S i : J i > J i +1 with ker ( s i>* = CO} 

and ker S.' = J. ^ J. , , such that T is unitarily 
l l l+l ’ J 

equivalent to the operator T' defined on ® ^2 ® * * • 

by the matrix (T! .} of operators given by TJ . = D.' , 

f J f 1 1 1 

T ' . , . = S! , and T ’ . .=0 if i t j , j + 1 . 

1 + 1,1 l ’ 1,3 * \i ) \j 

Further, H k (T') = for k ^ 1 . 

PROOF : We shall assume that all of the subspaces H k (T) > 

k * 1 , are non-zero. Put = H^ (T) and define 
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W* : J L ■> H-J^CT) by W* = I on . Put D£ = Dj . 

Recall that S x : •> H 2 (T) and that cl (ran Sj) - 

H 2 (T) . Let J 2 = (ker • Then dim J 2 = 

dim[ (ker ) X ] = dim[cl(ran S^) ] = dim H 2 (T) . Pick a 

unitary operator W 2 : H 2 (T) > J 2 (onto J 2 ) and 

define S[ = WgS^ = . Then 3[ : ^ — -> J 2 . Since 

ker = {0} , Vie have ker(S-j^)* = ker(S^W^) = {0} , 

x » 

and since J 2 = (ker S^) , we have ker = ker = 

J-^€9 J 2 . Setting D 2 = WgDgWg , we see that 


Suppose that we have defined Hilbert spaces 

5 J 2 — * * • — » that we have picked unitary operators 

VL mapping H i (T) onto JL , i = l,2,...,m , and that 

* 

we have put for i = l,2,...,m and 


- 

w Li s i w i for 1 

= 1,2,. 

..,m-l . Then define 

^m+l 

- [ker <S m w n ) ] x . 

Since 

cl (ran S ) = H , (T) , we 
m m+i 

have 

dim(J m+1 ) = dim 

(H m+ -^(T)) . Pick a unitary operator 

* 

W 

m+l 

mapping H m+1 (T) 

onto 

J m+1 an< * define 


S' = W .S 1 . Then, as above, S' maps J into J ,, , 

m m+l mm mm m+l 

ker (S’)* = { 0 } , and ker S' = J & J . , - Next, put 
m mm m+ i 

D m + 1 ’ ’ClW.wl ' notin K that D m+1 ls an operator on 

J m+1 ' 

Continuing this process, we obtain a sequence 
Jl 2 J 2 2 • • • °T Hilbert spaces and a sequence of unitary 



12 


operators (VL } with YL mapping J\ onto H^(T) for 
all i £ 1 . The associated sequences of operators {D^ } 
and {S^} are as in the statement of the theorem. 

Next put j = © J 2 © . . . and define W = © Wg © . 

Then W is a unitary operator mapping J onto H , and, 
of course, the operator T f = W TW e B(.J) is unitarily 
equivalent to T . A straightforward computation with the 
representations of T and W as matrices of operators 
shows that the matrix of T' relative to the decomposition 
J = © J 2 © . . . is as desired. 

Since T r = W*TW , we find that for all r,s > 1 , 
the equation 

{<T')*} r (T T ) S - (T') S UT')*} r = W*[(T*) r T S - T S (T*) r }W 

holds, so that W* maps M^(T) onto M^(T f ) in a 
one-to-one fashion for all k ^ 1 . It follows immediately 

that H k (T f ) = J k for all k ^ 1 . 

DEFINITION : Let 2 J 2 2 * • • be a finite or infinite 

sequence of Hilbert spaces and let J = ® . . . © J k © 

Let denote the orthogonal projection of onto 

J i+ 1 C_ and let denote the orthogonal projection of 

J onto JL for all i > 0 . Let T e £(J) . Then we say 
that T is in standard form if M k (T) = ® ^k+2 ® ••• 

for k 2 s 1 and if there exist operators DV e J. ) and 

1 3L 

non-negative operators P.^ e MJ.^) with ker J i+1 
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such that = 0 if k>i or k< i-1 , ir.p [J i = DJ 

and ff i+1 T|J ± = E^ for all i > 0 . 

THEOREM 1.7 : Let T e /9(H) be abnormal. Then T is 

unitarily equivalent to an operator in standard form. 

PROOF : We may as well replace T by the operator T' of 

Theorem 1.6. We also retain the notation of Theorem 1.6. 

* % 

Define = I on Jj . Next, write = Uj ( (Sj) sp 2 

U-^P^ , so that Pj is a non-negative operator on and 

is a partial isometry with initial space (ker sp 1 = 

— and final space cl(ran Sp = J 2 • t Since 

is onto Jg , it follows that : Jg > is an 

isometry with range Jg • Thus, Vg = E^U-^ is a unitary 

operator on J 2 and VgS^V-,. = V*U 1 P 1 = E^*!!^ = . 

Suppose that we have defined unitary operators c £(jp 

such that V* (s i-i )+v i-i " E i-l P i-l for 1 51 1 * m and 
non-negative operators P^ e ®(jp by P^ = (V^ (Sp Spp^ 

for 1 s i s m . We consider the polar factorization 

s'v = U p of S’V . Arguing as above, U : J > J 

mm mm mm m m+i m 

is an isometry with final space J m+ -^ > so that 

V* , = E U* is a unitary operator on J . Thus we 
m+1 mm m+i 

obtain a (finite or infinite) sequence of unitary 
operators e £(jp and a sequence P i e £(jp of 

non-negative operators such that ker P i = J\ & J i+1 
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and V*,,S.’V. = E.P. lor all i > 0 . We define 
i+I ii ii 

D7 = V?D.'V. for all i > 0 and put 
1111 

V - © Vg © . . . ® ® . . . . Then V e 0(J) is unitary, 

so that T" = V T'V is unitarily equivalent to T’ , and 

hence, to T . A straightforward calculation shows that 

7T, T” | J, = 0 if k > i or k< i-1 , that tr.T”|j. = V*D!V. = DV 

J. K 1 X 1 X X 

fir- i > 0 , and that ff i+1 TM \J± = V i+i S i V i = E i P i for 
all i > 0 . 

Finally, we note that an argument analogous to that used 
in Theorem 1.6 shows that H^(T”) = J k for all k > 0 . 

We note also that H k (T") = VWH k (T) and H fc (T) - (VW)*H k (T") 
for all k > 0 . 

To simplify our notation, we shall assume in the future 
that if T e 0(H) is abnormal and is in standard form, then 
H = © H 2 © . . . , where Hj 3 H 2 5 • . The diagonal 

(operator) entries of the matrix representation for T will 
be denoted by D k and the subdiagonal entries by S k = 

E k P k for all k > 1 . 

Next, suppose that T e -0(H) is abnormal and that T 
is unitarily equivalent to T^^ e 0(H^^) and to 
T^ 2 ^ e 0( H^ 2 ^) , where T is in standard form for 
i = 1,2 . Then there exists a unitary operator U such 

( T > 3fc (O 

that T = U T 'U . Arguing as in Theorem 1.6, we see 
that U maps M k (T (1) ) onto M k (T (2) ) for all k s 1 . 

Viewing T^^ , T^ 2 ^ and U as matrices of operators, 
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this means that U is a diagonal matrix with diagonal 
(operator) entries U k , where is a unitary operator 

mapping H k (T (1) ) onto H k (T (2) ) for all k a 1 . With 
some more work, the details of which we omit, one verifies 
the relations 



*p(2 ) ^ 

u k*k u k 


9 


[ E k 1) i* E k 1> ■ u k (E k 2)) * E k 2>u i 


and 


E k 1 ) r E k 1 ) i* ■ 


u k + i\ 




k+1 


for all k ^ 1 . In effect, these relations assert that 
each of the non-zero entries in the matrix representation 
of T^ is unitarily equivalent to the corresponding 
entry of . It follows that the representation of 

an operator in standard form is essentially unique. 

The next theorem deals with the relations that hold 
among the entries in the standard form for T . It shows 
that the structure of the abnormal part of an operator is 
determined by the action of the operator on the subspace 

Hj^T) . 


THEOREM 1.8: Let T e S(H) be abnormal and in standard 


form. Put C = fT]|H 1 (T) . Then 
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i * ) [®j] ^ ^1^1 * 

ii. ) [Dj] = S i _ 1 S*_ 1 - S*S i for i * 2 . 

iii.) sTd..., = D.S? for i ^ 1 . 

i i+l i i 

Further, the operators D.^ , i s 2 and the operators 
P^ , E. , i ^ 1 , may be determined explicitly in terms 
of C and D-^ . 

PROOF : Note first that 

00 

ker [T] D m, (T) = f"] ker (T*T r -T r T*) . 

r = l 

Hence, cl(ran[T]) (M^(T))‘ l = H 1 (T) . It follows that 
(T) reduces [T] , so that C = [TJIh^CT) is well- 
defined. In fact, [T] = C © 0 . If we represent [T] 
as a matrix of operators relative to the decomposition 

H = H x © H 2 © . . . © H k © . . . , 

then we obtain a matrix {C. .} of operators with 

> J 

C-, - C and C. , = 0 if i+j > 2 . 

Using the matrix representation for T relative to 
this same decomposition for H , we obtain another expression 
for [T] . Direct comparison of the entries in these two 
representations for [T] yield equations i. ) , ii . ) , and 
iii . ) . 

To complete the proof, note first that : 



17 


ker = kerCSj^) = ker(C-[D^]) , so that H 2 = 

(ker S^) 1 = cltranCC-fDjJ) } . Hence, H 2 (and thus, E-^ ) 

^ jjc 

is determined by C and . Noting that S-^S^ = P^E-^E^P^ 

and that e #(H^) is the orthogonal projection of 

H-^ onto H 2 , we have, since H 2 = cl (ran P^) , that 

S 1 S 1 = P 1 5 or » 

P 1 = (s i s i^ = (C-[D 1 ])^ . 

^09 

We note for future reference that S ^ S 1 = E 1 P 1 E 1 = P 1 1 H 2 * 

jjc ^ 

From iii . ) , S ^ D 2 = D i s i ■ X e /?(H 2 > is any 

jfc j|c 

operator satisfying S^X = , then S^(D 2 ~X) = O and, 

s|c 

since ker = (0} , D 2 = X . Note also that = 

S 1 D 1 S 1 and hence ) D 2 = ^®1®1^"^®1 P 1®1 * The ex P ress i° n 
on the right in the last equation represents a bounded 

operator even though will not, in general, have a 

bounded inverse. Substitution from above yields 

D 2 v = (D-[D 1 ])"^D 1 (C-[D 1 ]^v 

for all v e H 2 . 

A messy but rather easy use of induction completes the 
proof. We omit the details. 

The formulas: in Theorem 1.8 are nuich more manageable . 
in the special case dim # dim . for all k > 1 . The 

operators E fc : are unnecessary in this case, so that 

= P^ ^ 0 for all k a 1 . In this case, one obtains:. 
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the formulas 

P = (C - 2 [D .])* 

K i=l 1 

and 

D k + i - p k lD k p k for a11 k 2 1 • 

The formulas in Theorem 1.8 are easy to handle only in 
special cases. An important observation, however, is that 
the structure of an abnormal operator T is determined by 
its action on the subspace H^(T) . In case H-^(T) is 
an infinite-dimensional subspace, then, in the absence of 
stronger hypotheses on [T] and , nothing has been 

gained. If dim H-^CT) < ® , however, Theorem 1.8 asserts 
that the structure of (the abnormal part of) T is 
determined by two finite-dimensional operators. 

§2. It is easily seen that the decomposition for operators 

given in Section 1 may be trivial. If T is normal, for 

instance, then H = H (T) . Even if T is abnormal, the 

o 

decomposition will be trivial if kerfT] = {0} , since 
H = H^(T) in this case. In this section we shall consider 
other conditions which imply that our decomposition is trivial. 

LEMMA 2.1 : Let T e #(H) and suppose that M is a subspace 

of H such that TM M and M C_ker[T] . Then t|m is 

hyponormal. If T |M is normal, then M reduces T . 
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PROOF: Write 

B 
C 



wi 


th respect to the decomposition H = M © M 


[T] = 


[A]-BB* A*B-BC* 


B*A-CB* [C ]+BB* 


Then 


The fact that M c_ker[f] implies that M reduces [ T j . 

Let X = [T] |M x . Then [T] has the representation 

[T] = 0 © X relative to H = M © M X . Equating corresponding 

entries in the two representations for [T] yields 

[A] = BB* £ 0 , so that A = T |M is hyponormal. If A is 

normal, then BB* = 0 . Thus B = O and M reduces T . 

THEOREM 2.2 : Let T e #(H) have compact real part. Then 

H = H q (T) © H-^T) . 


PROOF : We may as well assume that T is abnormal. Assume 

that H £ Hj^CT) and let A = T l (H-j^ (T) ) X . From Lemma 2.1, 

A is hyponormal. Since Re T is compact, so also is 
Re A . 

Putnam has shown ([5], p. 43) that if T is hyponormal 
and abnormal, then the measure of the spectrum of Re T is 
positive. Since a compact self-adjoint operator has 
countable spectrum, it follows that a hyponormal operator 
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with compact real part is normal. In particular, A is 
normal. By Lemma 2.1 again, [H^(T)] X reduces T and 
T | (H-,^ (T) ) A is normal, a contradiction, since T was 
assumed to be abnormal. 

It is interesting to note what happens in case H 
is a finite-dimensional Hilbert space. Since every operator 
on a finite-dimensional space is compact, if follows from 
Theorem 2.2 that our decomposition is always trivial for 
finite-dimensional operators. Hence, non- trivial examples 
of our decomposition, much like non-unitary isometries, are 
purely infinite-dimensional phenomena. 

As a consequence of Theorem 2.2 we obtain a simpler 
expression for the normal subspace of an operator having 
compact real part. 

COROLLARY 2,3 : If T e /9(H) has compact real part, then 

00 

H-, (T) = fl ker (T*T r -T r T*) . 

1 r=l 

PROOF : H X (T) = H^H-^T) 

= M X (T) 

= O ker (T*T r -T r T*) . 
r=l 
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§3. Since our decomposition is trivial for operators on 
a finite-dimensional Hilbert space, we shall assume hereinafter 
that the underlying Hilbert space H is infinite-dimensional. 
Note that the easiest way to guarantee that the decomposition 
of an abnormal operator T is non-trivial is to assume that 
dim H^(T) < » . This ensures that H ^ H^(T) > of course, 
but it also means that H fc (T) ^ [0} for all k ^ 1 , since, 
from Theorems 1.5 and 1.6, we have 

dim(H 1 (T) © ... © H k (T)) ^ k dim H X (T) < « . 

The condition dim H-^T) < * is difficult to verify in 
many cases. In this section we will show that this condition 
is easy to verify in case T is subnormal. 

We recall that T e #(H) is subnormal if there exists 
a Hilbert space K 2 H and a normal operator N e /3(K) 
such that NH £H and T = N|H , in which case N is 
called a normal extension df T . We say that N is a 
minimal normal extension of T is the smallest subspace 
of K which contains H and reduces N is K itself. 

Halmos has shown that every subnormal operator has a 
minimal normal extension and that this extension is unique 
up to unitary equivalence. For proofs of these facts and 
an excellent discussion of subnormal operators, see [3], 

Chapter 16. 
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LEMMA 3.1 : Let T e #(H) be subnormal. Then 

1. ) ker [ T r ] ker ( (T*) r T s - T s (T*) r ) for r,s > 0 . 

00 

ii.) kerfT r l = (~\ ker((T*) r T s - T s (T*) r ) for all r > 0 

s=l 

00 

iii . 2 r\ ker[T r ] = H (T) . 
r=l ° 


PROOF : Let N e /3(K) , K D H , be the minimal normal 

extension of T . Since NH £H and T = N [H , we may 
write 


N = 


T 

0 


X 

Y 


with respect to the decomposition K = H © H 1 2 * . Then 


N* 



0 



for all k s l where X. = X and X , , = TX + XY n - 

1 n+ 1 n 

T n Xl + X n Y for all n ^ 1 . Computing both (N*) 1 *!^ 

g )jc p 

and N (N ) and equating corresponding entries yields 

(1) :(T*) r T S - T S (T*) r = X X* 

S I 1 

and 

(2) (T*) r X g = X-^yV • 


for all r,s > O . Putting r = s in (1) gives 
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ker[T r ] = ker(X r X*) = ker X* for all r £ 1 , Thus, 
ker ( (T*) r T s - T s (T*) r ) = ker(X s x*i 2 ker “ ker[T r ] , 
and 1 , ) holds. 

00 

From i . ) , f~] ker((T*) r T S - T s (T ) r ) contains 

s=l 

ker[T r ] for r 2: 1 , and since the reverse containment is 
trivial, the two sets are equal. Part iii . ) is an immediate 
consequence of part ii . ) and Lemma 1.3. 

Recall that if T e #(H) , then 

M, (T) = n O ker ((T*) r T S -T S (T*) r ) . 

K r=l s*=l 

if T is subnormal, then, applying Lemma 3.1, we obtain 

M, (T) = r\ ker [T r ] . 

K r = l 

In particular, if T e £(H) is subnormal, then 

(T) = (M 1 (T))' L - cl(ran[T]) . This shows that if T is 

subnormal and abnormal and if H / cl (ran [T]) (in parti- 
cular, if [T] has finite rank), then our decomposition 
for T will be non-trivial. 

It follows from Theorem 1.5 and the remarks above that 

k 

if T is subnormal, then M. (T) = f~\ ker[T r ] is invariant 

K r=l 

under T . Actually, a stronger statement is at hand. 

Taking adjoints in equation (2) in the proof of Lemma 3.1 

and putting r - 1 , we get XT = YX for all s > 0 . 

s s 
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Thus, ker[T r ] = ker X* is invariant under T for all 
r a 1 . In case r - 1 this observation is due to 
Stampf li ( [6 ] ) . 

If T is subnormal and abnormal and if H ^ cl(ran[T]), 
or equivalently, if ker[T] / {0} , then it follows from 
Theorem 1.8 that the structure of T is determined (up to 

'Jf. 

unitary equivalence) by [T] and T |H^(T) . In the special 
case in which [T] is of finite rank, the structure of the 
abnormal part of T is determined by two matrices. In 
case T is abnormal and [ T ] is of rank one, there are 
two constants which are a complete set of unita,ry invariants 
for T . 

PROPOSITION 3.2 : Let T e /5(H) be subnormal with one- 

dimensional self-commutator . Let U denote the unilateral 

o 

shift on K> o Then there exist scalars s^ , d^(s^ 
such that T is unitaril.y equivalent to the direct sum of 
a normal operator and s^U 4 d^I . 

PROOF : We may as well assume that T is abnormal. We 

have dim(H^(T)) « dim(cl (ran [T ] ) ) = 1 , It follows from 
Theorem 1.5 that dim(H k (T)) £ 1 for all k ^ 1 . Since 
H is the direct sum of the spaces H^(T) , k s l t and 
since H is infinite-dimensional, we must have 
dim(H k (T)) = 1 for k a 1 . From Theorem 1.8, T is 
unitarily equivalent . to a matrix with scalars d i on 
the main diagonal, positive scalars s 


on the first 
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subdiagonal, and zeros in the other entries. Further, 

since s j c d i c +l = d k s k and s * nc e s k > 0 » k s 1 , we 
have d k = d^ for all k s 1 . From Theorem 1.8 again, 

we have 0 = [d fc ] = s k-l s k-l " s k s k = ^ s k-l ' “ ^ S k ' 

for all k £ 2 . We then have = s-^ for all k a l 

and we conclude that T is unitarily equivalent to 

S 1 U + ^l* ' 

A careful examination of the proof of Proposition 3.2 
shows that the result holds if we assume only that 
T e 5(H) satisfies dimO^CD) = 1 . Since one may 
conclude from this that T is subnormal, the apparent 
generalization is really an artificial one. Finally, we 
note that Proposition 3.2 has been obtained independently 
by K. Clancey ( [2 ] ) . 

Recall that T e /3(H) is quasinormal if T commutes 
with T*T , or, equivalently, if T* [T ] = 0 = [T ]T . Thus, 
if T is quasinormal, then T x = 0 for every x e cl(ran[T]) 
The following lemma was first proved by A. Brown in [1]. 

LEMMA 3.3 : If T e /3(H) is quasi normal, then T is 

subnormal. 

PROOF : Write x e H as x = x-j+Xg , where e cl(ran[T]) 

and x 2 e ker[T] . Then 
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<[T]x,x> = <[T]x,x^> + <[T]x,x 2 > 

= <x, [T]x^> + <x, [T] x 2 > 

= <x ls [T] x 2 > + <x 2 , [T]x 2 > 

= <X2 , T*Txg> - <Xg , TT* x 2 > 

- 1|tx 2 || 2 ^ o . 

X 

Thus, T is hyponormal. Note that cl(ran[T] 2 ) = 

* X X 

cl(ran[T]) , so that T [T] e = 0 = [T] b T . A direct 
computation shows that the operator X defined on 
H © H by 


X 



[T] 


in 


is normal. Hence, T is subnormal. 


THEOREM 3.4: (A, Brown, fll) Let T e /?(H) be quasinormal. 

i 

Put R = cl(ran[T] ? ) and C = [t] }r . Then T is unitarily 

equivalent to the direct sum of a normal operator with the 

operator defined on R © R © . . . by the matrix of operators 

i 


{T. .} with T. , . = C 2 for i s l 

1,J X"ri,.X 

i j+1 • 



0 if 


PROOF : We may as well assume that T is both abnormal 

and in standard form. Since T is subnormal, we have 

^|i* ^ 

H^ = R , and since T [T] = 0 , we have T |h^ = 0 , or, 
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in the notation of section 1, = 0 . Since S i D i+l = 

D.S? and ker S* = {0} for all i 2 1 , we have D. = 0 
11 1 i 

for all i £ l . 

We next observe that since = 0 for i ^ 1 , the 

inclusion ker S. C ker T holds for all i ^ 1 . But T 

i 

is both abnormal and hyponormal, and hence, ker T = {O} . 

Thus ker S.^ = {0} for all i s l , and, since 

H. , = cl(S.H.) , we have dim H. = dim H, for all i ^ 2 . 
l+l ii’ i 1 

We have shown that T is a matrix of operators on R © R © . . 

whose only non-zero entries are the non-negative operators 

S i , i ^ 1 , which appear on the first subdiagonal. 

From part ii^) of Theorem 1.8, we have O = [D^] = 

2 2 

S . - S. for all i s: 1 , and hence, S. = S, for 

11 1 IX 

all i £ 2 . From part i: ) of Theorem 1.8, O = [D-^] = 

2 4 

C-S 1 . Hence = C £ for all i ^ 1 . 

If V e /3(H) is isometric, then V*V - I and V 
is quasinormal. Recall that if V is isometric and if P 
denotes the orthogonal projection on (VH) X , then 
VV* = I-P , so that [V] = I - (I-P) = P . This implies 
that H-j^CV) r el(ran[v]) = (VH) X . 

COROLLARY 3.5: (von Neumann, f 7 1 ) Every isometry V e /3(H) 

is unitarily equivalent to the direct sum of a unitary 
operator with a unilateral shift of multiplicity dim(VH) X . 



28 


PROOF : A normal isometry is unitary, since V V - I = VV 

Noting that [VjlH^CV) is the identity operator on (VH) X 
and applying Theorem 3.4, we see that V is unitarily 
equivalent to the direct sum of a unitary operator and a 
matrix of operators on R © R © . . . with identity operators 
on the first subdiagonal and zeros elsewhere, i.e., a 
unilateral shift of multiplicity dim R = dim(VH) 1 . 

We note that if T is quasinormal, then a complete set 
of unitary invariants for [T] is a complete set of unitary 
invariants for the abnormal part of T . In case V is an 
isometry, the fact that [V] = I on H-^(V) = ran[V] = (VH) X 
means that the scalar dim (ran [v]) = dim(VH)' L is a complete 
set of unitary invariants for the abnormal part of V . 

§4. We conclude with a simple application of our decomposition 
theorems to the study of quasi triangular operators. Recall 
that T e #(H) is triangular if there exists an increasing 
sequence {E k } of projections of finite rank such that 

{E^] > I strongly as k > “ and such that 

TE^ - E^TE^. = 0 for all k . We say that T is quasi- 
triangular if there exists an increasing sequence {E k } 

of projections of finite rank such that {E k } > I 

strongly as k ■> ® and [|TE k -E k TE k || > 0 as 

k ■> 06 . It is clear that every triangular operator is 

quasitriangular . We note that the study of quasi triangular 
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operators was initiated by Halmos ([4]), We shall use the 
facts, first proved in [4], that every normal operator is 
quasitriangular and that the direct sum of two quasi- 
triangular operators is quasitriangular. 

PROPOSITION 4.1 : Let T e /9(H) be abnormal with 

dimCH^CT)) < ® . Then T is a triangular operator. 

PROOF: Let denote the orthogonal projection of H 

onto [Mj t (T)] J ’ for all k ^ 1 . From Theorem 1.5, the 

sequence {E k } is an increasing sequence of projections of 

finite rank, and since TM^ (T) C_M k (T) for all k £ 1 , we 

also have T*E k ” E k T * E k = 0 for k ^ 1 . The abnor- 

00 

mality of T implies that M^(T) = {0} , or, 

equivalently, that tends strongly to I as k tends 

to infinity. 

The preceding proposition, together with Lemma 1.3 
and Halmos' results, yield the following: 

COROLLARY 4.2 : Let T e /9(H) satisfy dim(H^(T)) < 00 . 

Then T is quasitriangular. 

COROLLARY 4.3 : Suppose that T e. /9(H) is subnormal and 

}|; 

that its self-commutator has finite rank. Then T is 
quasitriangular . 

The answer to the following question is apparently 
unknown. 

QUESTION : If T is subnormal and has compact self- 

commutator, is T quasitriangular? 
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PROPAGATION IN RANDOM MEDIA 
G. Adomian, University of Georgia 

Abstract The problem of wave motion in a stochastic medium is 
treated as an application of stochastic operator theory to the 
case of partial differential equations and wave equations. 
Stochastic Green’s functions are found for the two point cor- 
relation of the solution process for a scalar wave equation 
with randomly time-varying index of refraction without mono- 
chromaticity assumptions. The results are connected to the 
theory of partial coherence and can be used to calculate spec- 
tral spreading in a "hot" medium. 



PROPAGATION IN STOCHASTIC MEDIA* 


G. Adomian, University of Georgia 
L. H. Sibul, Pennsylvania State Univ. O.R.L. 

Consider the scalar wave equation 

2 i 

v y( r >t>uO [— + a(r,t,w)]y(r,t,w) = xCr,t,u)) 

8t c _ 3 

where t e T represents time, r e R , w e Q on a probability 
space (£2, ? ,}i) . The quantities x and a, and consequently y, 
are all stochastic processes (s.p.) dependent on space position 
and time, i.e., random fields. The deterministic operator L is 

given by the ordinary d 'Alembertian V 2 - (1/c 2 ) 3 2 /3t 2 and the 

random part of the stochastic operator by R - (3 2 /3t 2 )a. 

Letting . L x = F we write the above as 

9 

y(F,t,m) = F(r", t,cu) + L _1 tf 2 / Zt 2 )a(T,t ,u)y(r,t 
where L is the inverse of the operator V 2 - (l/c 2 ) (3 2 /3t 2 ) . 
Denoting the Green's function for L" 1 by G(t,x), the last term 
is rewritten as / G(t,x) (3 2 /3t 2 )a(x)y(x)dx, i.e., thp random 
operator R is -(3 2 /3t 2 )a(t) . 


After integrating twice by parts we can write 

y(t) = F(t) + /[9 2 G(t,T)/3T 2 ]a(T)y(T)dT 

if quantities G(t,x) — ct(x)y(x) and [3G(t,x)/3x]a(x)y(x) 

vanish as t -> +_ » which we suppose does happen either because of 
the initial conditions (G and G’ zero) or because a is a reducible- 
to-stationary stochastic process. 


We write 

K(t,x) 

. K 2 (t,x) 


r(t,x) = S (-l) m K (t,x) with K 
m=0 i 


_ 3 G(t,x) 
3x 2 


a(x) 


= K(t,x 1 )K(x 1 ,x)dx 1 


-/■ 


3 2 G(t,x ) 3 2 G(x x) 

3 “Ct,) 2 a(x)dx J 


3x 


1 


3x 


K as before. 
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Kj(t , x) = jKCt J T 1 )K 2 CT i ,T)dT 1 , etc. 
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r(t,x) = KCt,r) - K 2 (t 3 T) + K 3 (t, T ) . 


= K(t ,t) - /K(t,T 1 )KCT 1 ,T)dT 1 + //K(t,T 1 )K(T 1 ,T 2 ) 


K(T 2 ,T}dT i dx 2 - 


= a(T) _J 


3 2 G(t,T 1 ) 3 2 GCt 1 ,t) 


9t 


3t 


3x 


a(Xj)a(T)dx^ + 


*// 


9 2 GCt J x 1 ) 3 2 GCx r x 2 ) 3 2 G(t 2 ,t) 


3xt 


3x; 


9x 


aCx 1 )a(x 2 )a(T)dx 1 dT 2 - 


-Thus we can determine the s.g.f. (stochastic Green's function) 
either for the spectral density s.m. (statistical measure) if it 
exists, or immediately the more general two point correlation 

(and mutual coherence functions) thus R (t^,t ? ) = 

jj G H (t 1 ,t 2 ,a^ ,cr 7 )R (c^ ,o 2 )da 1 da ? where is. found from h(t,x) , 

the random Green's function. 


The first term of G„ (which we do not write out) shows the 

H 

results for waves propagating in a deterministic medium. The 
other terms of G^ involving statistics of r show the effects 

of spectral spreading due to the stochastic medium. These are 
the terms lost by a monochromatic assumption. The calculation 
for a specific case presents considerable difficulty but can be 
made knowing the statistics (i.e., s.m.) of a (such as correla- 
tion if a is gaussian) . 

In the general nonstationary case, we make the time domain 
iterative treatment, and if we assume gaussian behavior for .the 
index of refraction, we observe the odd terms vanish in the 
series (terms involving products of odd numbers of a’s) and the 
even terms are negative. Thus in forming products y(t^)y(t 2 ) 

for correlations, the contribution of the spectral spreading or 
non -monochromatic terms of (i.e., the last three of the 

four term expression) are all positive. 

Our procedure involves no assumption of statistical independence 
of the solution s.p. or wave function and the stochastic index 
of refraction and makes no closure approximations. 

The first application of this work was the processing of a 
signal by a "stochastic filter" which randomly sampled the signal 



at intervals of time governed by a probability law. Work on 
optimization of stochastic systems and numerous other applica- 
tions is immediately suggested. 
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STATIONARITY CONDITIONS FOR 
-STOCHASTIC DIFFERENTIAL EQUATIONS 

This is a preliminary study of possible necessary and 
sufficient conditions to insure stationarity in the solution 
process for a stochastic differential equation. It indirectly 
sheds some light on ergodicity properties and shows that the 
spectral density is generally inadequate as a statistical 
measure of the solution. Further work is proceeding on a 
more general theory which gives necessary and sufficient 
conditions in a form useful for applications. 
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SECTION 1 


The following definitions and notation will be used 
consistently throughout this thesis. 

n) will be a fixed (but otherwise arbitrary) 
probability space with points to £ £1, a e-algebra 3 of 
subsets (probabilizable events), and a complete measure 
fi such that ^i(r) = 1. 

A random variable (r.v) x - x(to) will be a finite 
real-valued (or complex valued) measurable function defined 
on ft, i. e. , we require that (to :x(o!) < A} € 3 for all real 
numbers A. If x{to) is complex-valued, we require that 
x(to) = u ( to) + iv(co) where u and v are real-valued r.v. ‘s. 

Given a r.v. x(to), E(x) or < x > denotes the integral 
j x(to) dji(to) if this integral is defined. 

Given a parameter set T (which we usually take to be 
the real numbers), a stochastic process (s.p.) or random 
function (r.f.) on T is a real or complex-valued function 
X:Txn — > R(C) such that for each fixed t €T the function 
x t ( to) = X(t, to) is a r.v. Very often in our notation we 
will suppress the variable to and write X(t) for the r.f. 
Notice that a s.p. has two convenient interpretations. 

First of all, a s.p. is a family of r.v. ’s indexed by T, 
d.. e. , X = (x t (w):*‘— > 0n the other hand, if we 

emphasize the variable t and let T = R, then a s.p. X is a 
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collection of real-valued functions of a real variable 
(indexed by r.) . These functions are called the sample 
paths (realizations, trajectories) of the process. The 
measurability of X with respect to the variable a' says 
nothing about measurability with respect to the t, and in 
general the sample paths may be very badly behaved. How- 
ever, we will consider only measurable processes, i-e.* > 
functions X(t,ic) which are measurable with respect to 
the a-algebra where J is the family of Lebesgue 

measurable subsets of the real line. Then all the sample 
paths will be measurable. 

We let L 2 (r.) denote the Hilbert space of all square 
integrable r.v. ’s on Si making the usual identification of 
r.v. 's which are equal almost everywhere with respect to 
the measure 

We say that a r.f. X(t,u:) is second order if each 

r. v. x^, t £T, is a member of L^(ft). Thus X is second 
order if and only if jlx(t,w) | 2 dM(aO < * for all t£T. 

Note that a second order r.f. X induces a map into a 
space of r.v. 's Y : T — > L 2 (r.) defined by (Y (t ) ) ( U') = X (t , to) . 
The covariance function associated with the r.f. X is de- 
fined by r (s,t) = E(X(s)xTtT). 

A 

Once again let T = R and let X(t,a) be a second order 

s. p. Let Y be defined as in the preceeding paragraph.. 

We say that X is continuous i n the mean square sense at t^ 

if l.i.m. X(t) = X(t n ). This is equivalent to saying that 

t -t u 

1 X 0 

the function Y(t) is continuous at t Q relative to the 
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standard topology on the reals and the norm topology on 

L“(n). Similarly, we say that X(t) is differentiable in 

mean square at t Q if there is a r.v. (second order) r 

such that l.i.m. = r - Thus X is differentiable 

ft c t - t Q 

in mean square at tQ if and only if Y(t) is differentiable 

dY 

at t Q , and moreover r = ^ (tQ) . This same analogy carries 

over to integration (Riemann, Riemann-Stielt jes , Lebesgue- 

type) in mean square of X and the corresponding integration 

of Y. Hence the study of the mean square analytic properties 

of a (second-order) s.p. X is equivalent to the study of the 

2 

corresponding properties of a function Y:R — ■> L (ft). 

Throughout this thesis we will deal with the concept 
of wide - sense stationarity . Moreover, without loss of 
generality we consider only zero-mean processes, and con- 
sequently we take as the defining characteristic of a 
stationary process X the existence of a correlation function 
f such that r (s,t) = f(t-s). We define the spectral 
density function of the process by cp(u) = Je 2lTitu f (t)dt . * 


We use this definition of correlation function in 
accordance with Adomian [1]. Often in the lit eratu re the 
correlation function is defined g(s-t) = E(X (s)X(t)') which 
is the complex conjugate of our definition. We let 

<p(u) = Je 277itu f (t)dt be the spectral density function of 

the process whereas some authors may have ^ Cu ) = Je 2l7 ^^ u f(t)dt 

as the spectral density function. This of course will be 
the complex conjugate of our spectral density function. 
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Usually we consider only real processes, however if some 
result takes on a much cleaner form in the complex case 
we will note it. 

The physical interpretation of stationarity is well 

known (see Yaglom [11]). The following geometrical 

interpretation may provide some insight however. Note that 

a second-order process with the real line as the parameter 

2 

set is a map X: R — •> L (n) from the reals into a particular 

Hilbert space. Hence the relationship E(X(s)X(t)) = f (t-s) 

is merely a restriction on the behavior of the inner pro- 

2 

ducts of points in L (Cl) which lie on the curve associated 
with X. In particular, ||X(t)||^ - E(X(t)X(t) ) = f(t-t) = f(0) 
for all t, and so the curve X must lie on a sphere of radius 
f (0) centered at the origin. For stationary X, 

E(X(s + T)x(t+T) ) = E(X(s)X(t)) for all s, t, and r, and so 
if we think of the inner product as determining an angle 
between say the vectors X(s) and X(t), then this angle is 
invariant under translations of the parameter set, e.g. 
the angle between X(s) and X(t) is the same as the one 
between X(0) and X(t-s). A circle in R centered at the 
origin is an example of such a curve if the standard para- 
meterization is taken: thus, consider the curve 

x(t) = e^ cos t + e 2 sin t where e^ and e 2 are the standard 

2 

basis vectors for R . In general, we can replace the unit 

2 

vectors by arbitrary orthogonal vectors in L (n) of equal 
norm, call two such (distinct) vectors A and B. Then the 
process defined by X(t) = A cos t + B sin t is really just 
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a circle in L 2 (tt), and a simple calculation shows it is 
stationary. One of the most powerful results in the 
general theory of stationary processes is that every 
(continuous) stationary process is the limit of sums of 
processes of this special type. 

One is naturally interested in determining what sort 

of transformations of stochastic processes preserve station- 

arity. For the moment, we interpret the term "stochastic 

transformation" in the loosest sense, namely we call any 

rule which associates one or more processes with another 

2 

process a stochastic transformation (s.t. ) . In this 
sense there are many s.t.'s which carry stationary pro- 
cesses into stationary processes, and we list here just a 
few: 

i) Let U:L 2 (r2) — ■> L 2 (ft) be any isometry. Let 
F(t) be a stationary process. Then the process 
G(t) = U(F(t)) is stationary since E(G(s)GCt) ) = E(F (s)F (tT ) 
f(t-s). Let a be any complex number. Then the process 
H ( t ) = aU(F(t)) is stationary since E(H(s)H(t)) = |a| f(t-s) 
ii) Let F (t) and G(t) be stationary processes such 
that the smallest closed linear manifolds containing F and 
G respectively are orthogonal. Then F(t) + G(t) is a 

" 9 

For a more complete discussion of this term, see 
Section 4. One also may wish to consider the possibility 
of mapping a random function into a random sequence. In 
his dissertation Adomian presented and discussed the 
important example of a randomly sampled random function. 

He also sets up conditions under which a stationary random 
function is mapped in this manner into a stationary random . 
sequence. 
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stationary process since E([F(s)+G(s) ] [F(t)+G(t) ]) 

= f(t-s) + g(t-s) = u(t-s) where u = f+g. Note that in 
general the sum of two stationary processes is not station- 
ary- A necessary and sufficient condition that F(t) + G(t) 
be stationary is that E(G(s)F (t) ) + E(F (s)G(t) ) be a 
function of t-s, and we see that this is a fairly strong 
restriction. The fact that stationary processes do not 
form a linear manifold (in the space of all processes) 
causes a certain amount of difficulty in determining what 
s.t.'s preserve statipnarity . 

iii) Let the stationary process F(t) be n times 
continuously differentiable and let Cq, ..., c n be constants. 

n (k) 

Then the s.p. G(t) = Z c.F (t) is stationary and 

k=0 

E(G(s)G(t) ) = Z c.c. (-1)^ f^ k+ ^(t-s). We note that 
k,j=0 k J 

limits (in mean square) of stationary processes need not be 

stationary, and so it is unusual that linear combinations 

of derivatives of stationary processes are stationary. As 

^s 

a rule, the function G(s) = X n + f F(t)dt is not stationary 

u 0 

even though F is, and so integral operators do not in general 
preserve stationarity . Intuitively the solution to a 
stochastic differential equation is representable in the 
form of applying a stochastic integral operator to the 
forcing function of the differential equation; thus we see 
this operation will not often yield as a stationary solution. 
We now seek to determine conditions under which stochastic 
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differential equations do possess stationary solutions. 
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SECTION 2 

This section is devoted to the study of analytic ran- 
dom functions and their application to stochastic dif- 
ferential equations. We recall that if X(t) is a second 

order random function, then X(t) can be thought of as a 
2 

map X:T — > L (£2) . Usually T will be the set of real num- 
bers or some subset of the reals; more generally, T will be 
a subset of a Euclidean space. There is already a general 
theory of analytic maps from finite dimensional Euclidean 
spaces into Banach spaces, so we list here only the most 
relevant parts of this theory. 

Definition: Let B be a real Banach space. Let [c _ 

n n=0 

be a sequence of elements of B. Suppose there is a positive 
real number r such that the series I ||c n ||t n converges for 
all real numbers t satisfying |t| < r. Then the series 
L c n t n is called a power series centered at 0 with coeffi - 
cients in B. 

Notice that since a power series converges absolutely (by 
definition) in the space B and since B is complete, the 
series does indeed converge to an element of B for each 
appropriate t. The absolute convergence of power series 
allows us to rearrange the series however we like, and the 
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rearranged series will still converge to the same limit. 

The orem 1. Suppose £ a t n and L b t n are two power series 
for 1 1 | < r wi th coefficients in a^ Banach space B. J_f 
£ A n f n = 2 b^t n for all t € (-r,r), then a R = b n for each n. 

We will find this theorem on uniqueness of coefficients 
especially useful. For a proof, see Dieudonne [3]. 

Def i ni t ion . Suppose f is a function from the reals into a 

Banach space B. Suppose there are elements {C }" in B 

L n n=0 

such that f(t) = S(C n /n* ) t n for [t [ < r. Then f is said 
to be analytic at 0. 

In accordance with this definition, a second order random 
function X(t) is analytic at 0 (in the mean square sense) 
when there are second order random variables Xq.Xj,... 
such that X (t) = £(X n /n. T )t n for |t| < r. If we include the 
dependence on s: in our notation, we see that X(t,fa») = 
*X n U)t n )/n: and so an analytic random function is one 
which has this special sort of separation of variables. 

We have the following theorem which relates analyti- 
city of a random function to the analyticity of its co- 
variance function. 

Theorem 2 . A second order random f unc tion X(t) is analytic 
if and only if its covariance function F x (s , t) analytic 
at every diagonal point (t,t). If this condition is 
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satisfied, then F v (s,t) is analytic at each (s,t). 

More simply, a random function is analytic if and only if 
its covariance function is analytic. See Loeve [7] for a 
proof of Theorem 2. 

Returning to more general Banach space considerations, 
we have the following very important theorem, again from 
Dieudonne. 


Theorem 3. Suppose f:R — •> B, B a Banach space , is analytic 


at 0. Let f (t) = S(C n /n J ) t n . Then f is infinitely dif f eren- 

00 

tiable . Moreover , f^(t) = E (C j/n! ), f (t) is 

n=0 

(n) 


analytic , and f ' (0) = C^. 


Hence we see that the random variables occurring in a power 
series expansion of 4 random function are related in a 
simple way to the me^in-square derivatives of the random 

function. j 

\ 

Let us now turn! our attention to the question of 

i 

i 

forming a product of| J two elements each from a (perhaps 

different) Banach sijace. We are motivated by ordinary 

i 

differential equations of the form x’(t) + a(t)x(t) = f(t) 
but we would like tcj replace the functions involved in 
the equation by second order stochastic processes. Then 

!.tion X * ( t ) + A(t)X(t) = F(t) where 


we would have an equf 
X, A, and F are maps 


from the reals into the Banach space 
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L 2 (T0. There is a natural way of attaching meaning to the 

formal product A(t)X(t), we can form the pointwise product 

(A(t)X(t) ](o:) - A(t, u))X(t, a)) . In general, this expression 

2 

no longer defines a function into the space L (H) since 
A ( t , a:) X ( t , a') may not be square integrable (with respect 
to cc) for each t. Consequently, some care is needed in 
handing these products. 

Consider now the general case of forming products in 
Banach spaces. 

Definition . Let E and F be two (real) Banach spaces. A 
map P:E x F — ■> E is called a product on the spaces E and 
F if P is bilinear and satisfies the inequality 
|1 P(e, f ) || < ||ej| !|f|| for every e €E and f €F. 

We usually write ef for the product P(e,f). There are many 
examples of products, and the one which we will find useful 
is the following. 

Let E be a Banach space, let F = L(E, E) be the space of 
bounded linear operators on E. Note that F is a Banach 
space. Define the product P: E x F — •> E by P(x,f) = f (x) . 

It is elementary to verify that P defines a product in our 
sense. 

We prove now a few generalizations of well-known 


theorems and see how they fit into our more general framework. 
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Theorem 4 . Suppose P: E X F — > E is a product . Let 
A = La n € E and B = £b n £ F be two absolutely convergent 

n n 

series. Define C_ = £ a_ .b. = Z P(a -,b.). Then 

n J=0 n-j j j=Q n ~J J 

Z C n = AB = P(A , B) . 

We can prove this theorem by slightly modifying the proof 
for the case E = F = R found in Rudin [9] so we omit the 
proof here. However, as an important corollary we have: 

Let A: I — > L(E,E) and x: I — •> E be two functions defined 
on I, an open interval containing 0. If A and X are both 
analytic at 0, then the map f:I — ■> E defined by 
f(t) = A(t)(x(t)) is analytic at 0. 

Proof. Let A(t) = E A t n and x(t) = LX t n . Let t„> 0 
n no 

be such that both A(t Q ) and X(t^) converge absolutely. Then 

f(t) = A(t) (x(t) ) = (E A t n ) (E X t m ) = Z Ax t n+m = 

n n m m m, n n m 

” k k 

E t Z A, .X.. Then by Theorem 4, f(to) converges, and 
k=0 j=0 K 3 3 

so f(t) converges absolutely for |tj < t^. Hence f(t) 
is analytic. 

Keeping this concept of products in mind, we turn now 
to the question of differential equations involving functions 
from the reals into Banach spaces. Let I be an open interval 
containing 0 and let U be an open set in the Banach space B. 
Then a function f:I xU — •> B is said to be a time-dependent 
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vector field on U. A map a: I — •> U is an integral curve 
for f if a is differentiable and satisfies the equation 
a ' (t) f (t, a(t) ) . f is said to be Lipschitz at t 6 I 
if there is a constant K > 0 such that ||f(t,x) -f(t,g)|| < 

Kj|x-yjj for all x,y in U. f is said to be uniformly 
Lipschi tz on I if there is a single constant K > 0 such 

that |jf(t,x) - f (t , y ) || < K||x-y|| for all x,y 6 U and all 

t € I. We let C P (I x U) denote the set of all functions 
from I xU into B which are p times continuously differen- 
tiable. Let B a (X Q ) = {y € B:|[y-X 0 H < a}. Now we can 
state an existence theorem for certain differential 
equations in Banach spaces. 

Theorem 5. Let I, U, and B be as above . Le t Xq£ U. Bet 
a € (0,1) be a number such that B 2a^ X 0^ C Let 

f : I xU — > B bt? continuous , bounded by C, and satisfy ji 

Lipschi tz condition ( wi th constant K) uniformly wi th 
respect to I. If b < a/C and b < 1/K, then there is a 
unique integral curve a: (-b,b) x B a (X^) ■> U such that 
a(0) = X Q . If. f € C p (I xU), so is a. 

In particular, we note that if f is continuously differentiable, 
it is continuous and satisfies a uniform Lipschitz condition. 

For a proof of Theorem 5, see Lang [6], 

Let us see how to apply this theorem to stochastic 
differential equations. In particular, consider the equation 
X 1 (t ) + A (t)X(t ) = F(t), X(0) = X Q , where A(t) and F(t) 
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are second order random functions and Xq is a given second 
order random variable. Solving the above equation for 
X'(t), we have X' (t) = F(t) - A(t)X(t), and so the vector 
field (on L (£0) associated with this equation is given by 
f(t,x) = F(t) - A(t)x. To insure that the formal product 

O 

A(t)x is well defined for every t € I and every x t L 4 ({5), 

we assume that there is a constant K > O such that 

ess sup 1 A ( t , u3 | < K for all t€I. We will show that for 
it fc 

each t, A(t) can be thought of as a bounded linear operator 
2 

on L (ft), whereupon the formal product A(t)x will be a 

o 

product as defined earlier; in particular, A(t)x £ L (ft) 

2 

for every t € I and every x £ L (ft), and so the function 

2 

f(t,x) is a well defined vector field on L (ft). 

Suppose then that ess sup | A ( t , ui) | < K. Consider the map 

to 

A: I — -> L(L 2 (ft), L 2 (ft)) defined by (A'(t)x) (it) = A(t, co)x( it) . 

We show first that for a fixed t 61, A (t) € L(L 2 (ft) , L 2 (ft>). 

2 

Thus we must show that if x € L (ft), then A(t)x must be a 
square integrable random variable on ft. We have 
JjA(t)x] 2 (u:)d/i(it) = ^A 2 (t, tt)x 2 ( it) dji( w) < 

ess sup | A 2 (t, ai) | J x 2 (i»i)d/i( tc) < K 2 ||x|| 2 < ». Thus 

ft 

2 

A (t )x € L (ft). For a fixed t, A (t) is clearly linear, and 
moreover 

n v 1/2 

llATtTxlh TATtTx) 2 (ic)dAt(ai)) < (K 2 !!x|j 2 ) 1/2 = K If x || . 
Hence A (t) is a bounded operator and ||A (t ) |j < K. This 
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X' (t) + A ( t ) X ( t ) 

equals F ( t ) , so 
have F k - X k+1 + 


= L (t k /k.’)[X + E ( k )A X ]. 

k~0 k+1 j=0 3 J k 3 


by equating coefficients (Theorem 

1 ( i )A i X k-i’ or 
.j=0 3 3 K J 


But this 
1) , we 


X k + 1 - V V^Vr 


We are given Xq, so this formula allows us to determine 
each X n by induction. Now we have to show that the power 
series for X(t) with these coefficients converges (absolutely) 
in some neighborhood of the origin. 

We observe that the expression for X n can be put in a 

more convenient form. We claim that 


n 


n-1 

= xX + L , f 
nO k=0 k n 


where x fl is the coefficient of X Q in the original expression 

for X n (after successively substituting the previously 

calculated X^'s, j < n-1) ^nd ^f^ is the coefficient of F k 

in the original expression jfor X . x and . f are defined 
° \ n n k n 

inductively by the relations^ 


x 0 - l, 


n 


x j- - r ( n )A.x 
n+t j =0 J 3 n " J 


,f = 0 
k n 


for ft < k 


n 


k f k+r 1 > k f n + r Vj! 0 ( j ,A j k f n-j for n > k 



16 


Notice that the expressions for and ^f n are combinations 
of the Aj's only; the initial condition Xq and the forcing 
function F(t) are not involved in these coefficients. 

Proof of claim: We use induction on n. The claim 
clearly holds lor n = 1. Suppose the claim holds for k < n 
and examine the case k - n+1. 

n n n-j-1 

n+1 n J=0 j j n-j n J=Q j k=0 k n-j k n-j 0 


n n-j-1 


n 


= F - Z Z ( )A. 

,f . F, 

- Z ( 

n j =0 k-0 3 3 

k n-j k 

O 

II 

n 

n 

n-j-1 

(- Z ( n )A ,x )X„ + 

F - Z 

Z 

j._ 0 .1 J n-j 0 

j=0 

k=0 


n-J 


? A d k f n- d F k' 


n 


But - Z ( n )A.x = x ,, so all that remains is to show 
j _^q ,7 J n J n+j. 


F n 'X “X" 1 <J> A J k f „-j F k ' . r „ k f n + l F k' 


n 

Z 

k=0" 


Fix an integer p such that 0 < p < n. What is the coefficient 

of F in the left hand side of the above equation? Notice 
P 

that k - p only when j satisfies n-j-1 > p, i..e., 
j < n-p-1. Thus we get an F for j = 0,1 n-p-1 and k = p. 


Hence the complete contribution involving F 


n-p-i 

-F Z (.)A . f 
P j=0 \j J P n-j 


But P f k ! 


0 for p > k, 


is 

so if p > n-j 


we have f „ .= 0. 
P n-j 


Since p > n-j for j > n-p, we have 
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n-p-i n-p-1 a 

A ( >j p f -j = - A 

o 

n n n-j-l 

- I ( n )A. f .= f Hence F - I £ C)A. ,f . F. 

j_ 0 J .1 P n-j p n+1 n j=Q k _ Q .1 j k n-j k 


■ r . f , F, and the induction is complete. 

k « K II "f" X K 
=0 


As a consequence of the above relationships, we have 


n-1 

X ( t ) - Kt'Vn.’U •= I(t%:)[x X + Z k f F k ] = 

n k=0 

n-1 

« X n L(x/n:)t n + r(t n /n:) ( I .f F, ). We will now 
0 n n n k=0 k n k 

place additional restrictions on A(t) so that we can prove 
the above power series converge. 

Let A ( t ) - L(A n /n')t n , and suppose there is some con- 
stant K such that ess sup I A (cc) I < K n for each n. Then 
each A n (cc) can be thought of as a bounded linear operator 
on L 2 (Ct), i^.e. , A n € L(L 2 (fi), L 2 (f^)). Also ess^up | A (s , ui) [ < K' < » 
for some K’ and for all s in some neighborhood of 0, and so 
our original restriction on A(s, ui) (allowing us to form 

products) is satisfied. We wish to show that A(s) = Z(A n /n')s n 

2 2 

is an analytic map from I into the Banach space L(L (H), L (H)). 

First we need to calculate the norm of A considered as an 

n 

2 2 

element of L(L (Ci) , L (fi)), and we have the following theorem. 



18 


Theorem 6 . Le t A: ft — > R J^e a random variable such that 

ess sup | A ( oo) | < 00 . Then the norm of A considered as an 
2 2 

element of L(L (£1), L (ft)) jus ess sup |A(co) 

Proof : Let (!Aj| denote the norm of the linear operator 

generated by A. Then | j A |l = sud j|Ax|[. Let x:f 2 — ■> R 

l|x||=l 

be such that ]|x|j = 1. Then 

!|Ax|l = ( i'(Ax) 2 (cc)d^(ai)) 1//2 - ( Ja 2 (cc)x 2 (ui)d ju( cJ ) 1//2 < (ess sup A 2 (cc) 

f? h ^ 

2 1/2 

J x (a’)dfi(a') ) 7 = ess sup |A(ui)| ||x|| = ess sup |A(oo)|. 

r a “ 

Hence jl A |j < ess ( sup |A(to) j. We show now that |f A | j > ess sup | A ( a;) 

Cc 

Let c > 0 be given. Let K = ess sup |A(io) | and define the 

set D ■= { us r l A ( w) | > K - e}. We may suppose without loss of 

- 1/2 

generality that /i(D) = 6 > 0. Define x(tc) = x(w)6 
where x(^) = 1 for w € D and x(w) = 0 otherwise. Then 


||x!| = (j x 2 (w)d^<ai>) 1/2 = (J 6 -1 dM(co)) 1/2 = (^(D) 6" 1 ) 1/2 = 1, 
r. d 

and j|Ax|j = (J A 2 ( oc) x 2 ( to) dji ( oj) ) 1//2 = (6 -1 J A 2 ( <r)d/it( to) ) 1//2 > 
fl D 

> (6 1 (K- e) 2 fi(D) Z^ 2 = K-e. Hence ||a|| > K-e, and since e 
is arbitrary, we see that ||a|| > K. Thus ||A|| = ess^sup [ A ( cci) | . 
QED 

We now see that L(A n /n! )t n is a power series in 
L(L 2 (C), L 2 (ff») since Z(||A n |j 1 t n 1/n.’ ) = 
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Z (ess^sup |A n (co) 1 |t| n /n.') < Z (K n |tj n /n.' ) = e K ^ < 00 . 

Hence A(t) - Z(A t n /n! ) is analytic in L(L^(ft), l/*(ft)). 

n t 

Form the function y(t) = -f A(s)ds where integration takes 

*0 

r> 2 

place in L(l/"(ft), L (ft)), and then consider the bounded 
linear operator (for each t) exp y(t). This is an analytic 
map, and simple algebra and an inductive proof shows that 
its power series has the coefficients x n defined previously. 


Hence applying the corollary to Theorem 4, the function 


X n exp (-1 A(s)ds) is an analytic map from I into L (ft). 

u l o 

Now consider the expression: 
t ^t y 

exp (-j A(s)ds) J exp (J A(s)ds) F(y)dy where the indicated 
0 0 0 

integrations involving the exponentials take place in 
2 2 

L(L (ft), L (ft)) and the remaining integration takes place 

2 2 
in L (ft). Since F(y) is analytic (in L (ft)), 

, y 2 
exp (J A(s)ds) F(y) is analytic (in L (ft)) as before, and 

° t 

consequently so is its integral j ; we apply once more 

t 0 

the operator exp (-J A(s)ds), so the whole expression defines 

0 

2 

an analytic function in L (ft). Again an inductive proof 


shows that the coefficients of this analytic map are 
n-1 

Z .f F. as previously defined. Hence our power series 
k=0 k n K 

for X(t) converges (absolutely) in some neighborhood of 0, 
and analyticity is established. We summarize our results 
with the following theorem. 
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Theorem 7 . Let F(t) and A(t) - £(A (a:) /nl ) t n be analytic 
second order random f unc tion s and let be a^ square 
integrable random variable . Suppose there is a constant K 
such that ess_sup | A n < co) | < K n for every n. Then the 
stochastic differential equation X f (t) + A(t)X(t) = 

F(t), X(0) = Xq has a unique analytic solution . 


Note that the extension of this theorem to higher 
order equations is trivial. If we have the equation 
X (n) (t) + ^(t) +• • •+ a Q (t)X(t) = F(t) and the 

i C k ) . 

coefficients are analytic and satisfy esssup |aj (0) | < 

for some set [K . and every k, then we write the equation 

/ J J 


in a vector form 


where 


X' (t) = A (t)X(t) + G (t ) 


and G(t) = 


A ( t ) = 


F (t) 


0 

0 


1 

0 


0 

1 


-o^Ct)-^ (t) 


0 

0 


... c* n _ j (t) 


Note that analyticity of the a.(t)’s implies that of 

J 

A(t) (as a bounded linear operator on (L^(ft)) n ) and G(t) 


is obviously analytic. Hence the same techniques of our 
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theorem extend to this case and to the state space equations 
of stochastic control theory, in particular to the recent 
work of Leon H. Sibul (dissertation) . ^ 

Turning to the question of stationarity , we are interested 
in finding necessary and sufficient conditions that an 
analytic random function be stationary. We will assume all 
our random functions satisfy < X(t) > = 0. Suppose then 
that X ( t ) = L(X /n.')t n is a real analytic random function 
with the (analytic) covariance function T(s,t). Suppose 
also that X(t) is stationary. Then there is some function 
f : R — > R such that T(s,t) = f(t-s). Note that f(u)=f(-u). 
Since r(s,0) = f(-s), we see that f is analytic (at 0), 
so there are real numbers c n such that f (s) = £(c n /n. r )s n . 

Let us see how these constants are related to X(t). We have 


r(s, t) - < X Cs ) X ( t ) >•< £(s m X /m.') I(t n X /n.' > - 

m m n n 

- I I (s J t n ' J /j; (n-j).') < x .x ,> - 
n-0 j-0 3 

n 

= £ (1/n. 1 ) £ ( n )s J t n “ J < X X>. But 

n=0 j=0 J n J J 

co co n 

f(s-t) = I (c (s-t) n / n.' ) = £ (1/n .’) L (-1) n-j c ( n )s j t n " j . 

0=0 0 n=0 -i =0 n J 


Since f(s-t) = T(s,t), we have these two power series (in 

two variables) representing the same function, hence their 

coefficients must be equal, thus (-l) n J c =< X . X.>. 

n n-j j 

Rewriting this last equation, we have < X X >= (-l) n c 

& n m n+m 


Sibul, L. H. , Application of Linear Stochastic 
Operator Theory , Pennsylvania State University disser- 
tation, 1968. 
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On the other hand, suppose we have a zero mean analytic 
random function X(t) = r(X n t n /n. f ) such that there exist 
constants {c n l satisfying < X n X m > = (-l) n c n+m . Then 
the above equations show that X(t) is stationary. Thus we 
have the following theorem. 

Theorem 8 . Let X(t) = E(X n t n /nJ ) be a ( zero mean ) real 
analytic random function . Then X(t) stationary if and 
only if there are constants {c } such that < X n X m > = (-l) n c n+m . 

It is clear that a set of constants {c^} satisfying 
the condition of Theorem 8 cannot be completely arbitrary. 

In fact, we must have 

c 2k+r °> 111 c 4k i °< and 411> c 4k+2 ^ °‘ 

2k+l 

To see i), note that < ^k+l^O^ = c 2k+l = ~ C 2k+l 

and < X 0 X 2k+1 > = (-l)°c 2k+1 . Since X(t) is real-valued, 
we have -c 2k+1 = c 2k+1> i . e. , c 2k+1 = 0. This is to be ex- 
pected since f(t) must be an even function. Also 
° < < X^k > - < X 2k X 2k > - (-1) c 4k - c 4k and 0 < < X 2k+1 > - 

<X 2k + l X 2k+l > " ( - 1>2k+lc 4k+2’ hence ii) and 111 > are 
proved. By defining d = |c 2n |, we can write in the 

00 

form f(t) = E (-l) n (d /<2ri)! )t Zn where d > 0 for all n, hence 
n=0 n 

f(t) is representable by an even, alternating power series. 

(Note that d = <X Z >). 

n n 
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Theorem 8 can be reformulated in the following way. 


Theorem 9 . Let X(t) - E(X n t n /n' ) be a ( zero mean ) real 
analytic random function . Let A = I x q» x 2 > • • . >-^2n' * ‘ * ^ 
and B = {X^ , X^ , . . . , X 2 ll+ } Then X(t) is^ stationary 


if and only if A ij3 orthogonal to B and 
iJ <X 2n X 0 > - <X 2(n-k) X 2k > 

**> <X 2n + l X l > - <X 2(„-k) + l X 2k + l > 


k = 0, . . . , n 
k = 0, . . . , n 


and 


iii ) <X 2n X 0 > = _<X 2n-l X l > for a11 n > 1 - 


Proof : Suppose X(t) is stationary. We show that A_L B 

first. < X 2n X 2k+1 > = (-1) n c 2n+2k+1 = c 2(n+k)+l = °‘ Hence 


A1B. Also, 
1) < X 


2 (n-k) X 2k > ^ ^ c 2n- 2k+2k c 2n <X 2n X 0 > 


o\ / v Y N 

} X 2(n-k)+l X 2k+1 K L) c 2n-2k+l+2k+l = 

“ c 2n+2 = (_1) c 2n+l+l = <X 2n+l X l > 


,2n-l 


3) <X 2n-l X l > c 2n " c 2n <X 2n X 0 >! 


so the first half of the theorem is proved. 

Suppose now the second half of the theorem holds. 

Define {c 3 by the equations 0 m = 0,l,..., and 

c 0 = < X 0 X rt > m = 0,l We will show that <X .X . > = 

Zm Zm 0 n- j j 

= (-1)° for 0 < j < n and all n, whereupon Theorem 8 

tells us that X(t) is stationary. Suppose first that n 

is odd. If j is even, n-j is odd and x n _ j f B, hence 
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<X .X.> = 0 since X.€ A. Thus <X X.> = O = (-l) n-J c 
n-j .3 J n-j j n 

since n = 2m+l for some m. If j is odd, n-j is even, so 

X ,t A and X.€ B, hence <X X.> = 0 = (-l) n “^e as before, 
n-j J n-j j n 

Now we show Theorem 8 is satisfied for even n. Let n = 2p. 

First consider the case where j is odd, let j = 2q+l. 

Then 

<X n-j X j > * <X 2(p-q)-l X 2q+l > " < X 2 (p-l-q)+l X 2q+1 > " 


" <X 2(p-l) + l X l > - <X 2 P -1 X 1 > * - <x 2p x 0 > 
- (-l) 2(p ” q) " 1 c„„ - (-l) n_J c_. 


Now suppose j is even, j = 2q. Then 


<X ,X.> = <X Q . > = < X 0 X n > Crt 

n-j j 2 (p-q) 2q 2p 0 2p 


- (-l) 2(p - q) c 2p = (-l) n ' J c n 


as was to be shown. Hence X(t) is stationary. QED 

We now have developed a technique for finding the power 
series coefficients of solutions to stochastic differential 
equations and we also have theorems which tell us when a 
given analytic stochastic process is stationary, so in 
principle we have the machinery to determine conditions 
under which a given equation will have stationary solutions. 
We present some examples to show how this may be done. 


Example 1 . We know that the derivative of a stationary 
random function is stationary. When will the integral of 
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a stationary (analytic) random function be stationary? 
This question is equivalent to determining stationary 
solutions to the differential equation X'(t) = F(t), 
X(0) = X Q where F(t) is the given stationary (analytic) 
random function and the random variable Xq is yet to be 


specified. The soltuion to this equation is 

X(t) = X- + f F(s )ds = X^ + F^t + F-.t 2 /2: + . . . = I (X t n /n.’ ) 
0 0 0 0 1 , n=0 n 

where X = F , for n > 1. 
n n-1 — 

We now apply Theorems 8 and 9 to this random function 
to see what additional conditions we need to place on Xq 
to guarantee stationarity . Theorem 9 tells us that in 
order for X(t) to be stationary, it is necessary that 
<X 2n X 0 > = (-1)° <X 2 >, ' ’ we raust have <F 2n+l X 0 > = 

- < x 2(n+l) X 0 > " ( - 1,n+1<X n + l> * (-l)" +1 <r*>. Hence 


our first restriction on Xq is that it must satisfy the 

n . i n 

relations < F 2n+l X 0' > = <F n >. Moreover, Theorem 9 

requires that < x qX 2|[1+ ^> = 0 for all n, hence our second 
requirement is that < XqF 2ii > = 0 for all n. Since F(t) 
is stationary, there are constants [f } such that 
< F n _jFj> = (-l) n ^f^. Define constants £c n } by the 

relations c 2n+l = c 0 = < X 0 anc * c n+2 = - ^2n‘ We 

show that < X .X > = (-l) n **c . 

3 J 


Case 1. Let n be odd, n = 2k+l. We must show 

< X .X.> = 0 for all appropriate j. For i = 0, <X .X.> 
n-j 3 J n-j j 

= <F ,X^> = <F 01 X rt > = 0. For j > 1, <X .X.> - 
n-1 0 2k 0 J — ’ n-j j 
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= < F 




ince 


the s with odd subscripts must be zero. 


Case 2. Let u be even, n = 2k. For i 0, < X .X > 

n-j j 

<X n X 0 > ~ V F n-l X 0 > “ <F 21:-1 X 0 > = < F 2 (k-D+lV * 

■ ( - 1)k <f k-i> - (-i> 2 k " 1 f 2(k _ 1) - 


2 k n 

( _1) c 2k “ c n as required. For j > 1, <X Q _.X.> 


J J 


= < F 




2k-2 


' ( - 1)2k ' J ' lf 2( k -l> - <-l> 2 k - J e 2(k . 1)+2 - (-l) 2k -Jc 2k - 

- (-1) as required. Hence we see that necessary and 

sufficient conditions for X(t) to be stationary are that 
<F(t)> - 0, <F 2n+1 X 0 > - (-l) n+l <F 2 >, and < F 2n X 0 > - 0. 

These last two conditions may be combined by requiring that 


<X Q F(t)> = < X Q Z(F n t n /n.')> = E(t n /n: ) < X Q F n > = 

I(t 2n /(2n) .') < X Q F 2n > + S(t 2n+1 /(2n+l>:) <X 0 F 2n+1 > = 

= E(t 2n+1 /(2n+l):) (-l) n+1 <F 2 > = -E(t 2n+1 /(2n+l).’) * 

x (-l) n <F 2 >, 
n ’ 

i-.e. , we require that the correlation function of F(t) 
and X Q be given by 

<F(t)X > » -L((-l) n t 2n+1 /(2n+l):) <f 2 >. 

n 
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Example 2 . We present here an example of a differential 
equation in which the coefficient function as well as the 
forcing function is random. Consider the equation 

X’(t) - Ae” tA X(t) = AB (e tA - 1) 

X(0) = B 

where A is an essentially bounded r.v. Writing the equation 
in the form X’(t) + A(t)X(t) = F(t), we calculate that 
A (t ) -Ae"" tA = £(-A) n+1 t n /n: i- e. , A n = (-A) n+1 . Also 

cc 

we have F(t) = AB(e 1:A - 1) = E A n+ ^Bt n /n.' so we have 

n=l 

n+ 1 

Fq~ O and F n ~ A B for n > 1. We have a solution 

X(t) - ZX n t n /„: where X - x X + Z k * n F k - 

k=0 

n— ^ k+1 n-1 k+1 

= x B + E . f (A K 1 B) = B(x + E .f A K X ) = BC 
n k n n k=1 k n 11 

where we define C n to be the expression in the brackets. 

Remember that both x„ and . f are polynomials in the 

n k n J 

variables A,,,..., A , , and since the variables A. are 
0 n-1 k 

k+1 

polynomials in A (A, = (-A) ) , we conclude that C is a 

k n 

polynomial in the r.v. A. Now if X(t) is to be stationary, 

2 

we must have = -<X^>, and this condition becomes 

2 2 

<A B *> = 0 and hence we know that any polynomial in A is 

orthogonal to any polynomial in Thus we have <X X > = 

n m 

2 

= <BC BC > = <B C C > = 0 for n + m > 1 and consequently 
n m n m — 

Theorem 8 is satisfied. Thus the solution is stationary 

2 2 

if and only if <A B > = 0. Note that we did not actually 
have to calculate the solution to make this conclusion. 
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Example 3 . Consider the equation X"(t) + BX(t) = 0, 

X(0) ■•= X Q , X ' (0) = X 1> whei’e B is a random variable which 
is positive a.s. This equation is a stochastic analog of 
the harmonic oscillator equation. Suppose X(t) = £(X n /n.')t n , 

then X”(t) - Z(X ji+2 /n: )t n , so 0 = X”(t) + BX(t) = 

- r(X n+ 2 /n:)t n + B r(X n /n.’)t n « I((X n+ 2 +BX n )/n:)t n , i.e., 

X 9 = -Bx for all n. It is easy to see that the coefficients 
X n are given by the relations X 2n = (-B) n XQ and X 2n+1 = (“B) n Xj. 

The closed form expression with these coefficients is 
X(t) = X Q cos /B t + (X 1 //B) sin /B t. 


To see when this random function will be stationary, 
let us assume that the random variables B, Xq, and X^ are 
all independent and < X Q > = < X^> = 0. We apply Theorem 9, 
so define A = {Xq, X 2 ,X 4 , . . . } and C = {X^X^Xg, . . . }. Now 
A and C are orthogonal since ^ X 2n X 2p+l^ = < (-B) n X Q (-B) P X^> = 

= < (-B) n+ P > < X Q > < Xj> =0. We check the last three 
conditions of the theorem: 

<x 2(n-k) x 2k > ‘ < (-B) n - k X 0 (-B) k X 0 > - 


< (-B> n X 0 X 0 > - <X 2 n x o> 

<X 2(n-k) + l X 2k + l > * <(-B) n - k X 1 (-B) k X 1 > 

< (-B) n X lXl > - <X 2n+1 X 1 > 


iii) < X 2n X 0 > = < (-B) n x^> = < (-B) n > < Xq> 
(-l) n < B n > < Xq> . 
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Also <X 2n _ 1 X 1 > < (-B) n-1 X^> = (-1) 11 1 <B 11 1 ><Xj>. 

But these expressions must be negatives of one another, 
and so <B n > < B n_1 > < X^>/< > . Let c= <X^>/<X^>, 

then < B ll > - c < B tl_1 >, i .e. , < B n > = c 11 for every n. The ; 

characteristic function for B is < exp itB> = 

T i n t n <B n >/n.' = D(itc) n /n.’ = exp itc, so B = c a.s. 
since characteristic functions are unique. Thus if we 
assume B, X Q , and X-^ are independent and < X Q > = < X.j> = 0, 
the solution is stationary if and only if 
B ( - < X^>/< Xq > a.s.. 

These three examples serve to indicate a fairly 
wide range of questions which the techniques of this section 
can answer. The first example provides us with a criterion 
which we will use in section 3 to characterize the general 
form of stationary solutions to the equation. Example 2 
shows that we may characterize conditions for the existence 
of stationary solutions without having to find the solution 
itself. Example 3 says that a more general canonical form 
of simple stationary processes (i.e. adding randomness in 
the time functions of A cos t + B sin t) is not needed. 
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SECTION 3 

In this section we use some of the tools of random 
harmonic analysis to develop further conditions guaranteeing 
stationarity of solutions to certain stochastic differential 
equations. We make extensive use of the harmonic decom- 
position theorems concerning stationary processes to find 
sufficient conditions to be placed on the initial values 
of the equations. We then calculate the correlation 
function of the resulting solutions. Moreover, we show 
that under fairly general conditions we can get asymptotic 
stationarity independent of the initial values. We begin 
with the notion of an orthogonal random measure. 

Let 3 denote the family of Borel subsets of the real 
line and let 3 denote the subfamily of bounded Borel 
subsets. Then a function x St — > C is called an 

orthogonal random measure if 

i) ^(A) € L^(ft) for each A € 3 
ii) E(4(A>) = 0 for each A € 3 
iii ) E(4(A)T7 bT) = 0 if A a B = 0, A , B 6 3 

iv) the relation M(A) = E(|£(A)| ) defines a measure 
on 3. 

The measure M is called the absolute measure associated with 

i. If f:R — •> C is a complex valued measurable function 
b 2 

such that j | f ( X) | dM(X) < ®, we can define the integral 
a 
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J f(X)£(dX) in a natural way (see Rozanov [8]). 
a 

We say that a second order r.f. Tj(t) is separable 

2 - 

if the smallest closed linear manifold in L (it) containing 
the r.v.'s {. tj ( t ) } . ^ is separable, i-.e. , it contains a 
countable dense subset. We remark that a continuous r.f. 
tj ( t ) is necessarily separable, for let V be a basis for 
L 2 (R) and let {t }“ =1 denote the set of rational numbers. 
Then for each n, there is a countable subset of U 


(call it H n = th } x ) such that U<t n >' = I 

m=l 

Let H = (a be an orthonormal basis for the smallest 


l j -« 

n J n=l 

closed linear manifold containing w H 

n=l 


n 


We claim that 


for every t, rj(t) = £ E(rj(t)a )a . This equation obviously 

1 11 ll 

holds if t is rational, so we suppose that t is irrational 

and € > 0. Since tj is continuous, there is a t fc such that 

i|Tj(t) - Tj(t k ) II < e/3. There is an N such that if n > N, 
n 

then j| rj(t. ) - £ E(rj(t. )a )al| < c/3. Hence, for n > N 
k n K m m — 

m=l 


n 

i Tj(t ) - £ E(rj(t)a m )a m ji < i|rj(t) - tj(t, )|l + 


1 111 K 

+ j|T}(t k ) - £ E(Tj(t k )i“)a m || + || £ E ( T J< t k >^> a m - s E(T}(t)a^) a m |t < 
m~l m=l m^l 


m m 1 


n 


< e/3 + e/3 + it Z [E(rj(t.)a ) - E(rj(t)a ) ]a {| < 

I k in in m 

, 

< 2 e/3 + ||rj(t k ) - tj ( t ) || < e. 


Hence the curve rj(t) is contained in a separable manifold 
and so rj(t) is separable. 
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Rozanov proves that every separable stationary process 
(with measurable correlation function) is representable in 
the form 

T?(t> - J* e 2 ? 7 itX t(dX) 

— CO 

where £ is an orthogonal random measure. is called 

the spec tral random measure associated with rj ) . This is one 
of the most powerful results in random harmonic analysis 
and we will make extensive use of this theorem throughout 
the rest of the paper. Relevant discussions of these 
integrals and decompositions are presented in Rozanov's 
text [8] and in Irzhina's paper [5]. 

In particular, we are especially interested in the 
equation 

(D X' (t) + aX(t) - F (t ) 

X(0) - X Q 

2 

where a is an essentially bounded r.v., Xq € L (ft), and 
F(t) is a stationary continuous r.f. We will also suppose 
that a and F(t) are independent. As is well known, the 
solution to the above equation can be. expressed as 

X(t) = X n e“ ta + e" ta J e ya F(y)dy. 

0 

00 

We write F(y) = J e ffayX £(dX) where £ is the spectral 

— 00 

random measure associated with the process F(y). Assume 
for the moment that the following calculations are valid and 

calculate J e ya F(y)dy = J e ya J e 2ff * yX 4 (dX)dy = 

0 0 
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= f * e yi2iriX+ii) dy 4(d\) = f ((e t(27riX+a) -l)/2ffiX+a)4(dX). 

_co O ~°° 

Thus 

X(t) = X n e" ta + e“ ta j ^e t(27riX+a) -iy2ffiX+a)4(dX) 

. — oo 

= X Q e“ ta + J* ((e 27ritX -e" ta )/2ffiX+a)4(dX) 

( 2 ) 

= e _ta [X - J (4(dXy27riX+a) ] + J (e 2irL tX /27TiX+a) £(dX) 

^ — oo — oo 

= K(t,a,X 0 ,F) + Y ( t ) 

where K and Y are the respective summands from above. 

We show now that the random function Y(t) is a stationary 
process. 

E(Y (s )Y (t) ) = E( J(e 2fflsX /2TTiX+a) 4(dX) • 

• J(e 2 lTit/i / 27 ri^+a)£(d/i)) = 

= E(J'j , (e 2iri ^ sX “ t ^V(2iriX+a) (2irifi+a) ) £(dX) £(dfi) ) 

= JjE(]/(2triX+a) (27ri/i+a) )e 2ni ^ sX £(dX) £(djj) ) 

- Je(1/ |2TTiX+a [ 2 )e 2ffiX<S_t) G(dX) 

where G is the absolute spectral measure of F. As we 
see E(Y(s )TTt ) ) is a function of t-s only, hence Y is 
stationary and its correlation function is 

f ( r) - jE(l/|27TiX+a | 2 )e 2TriXT G(dX). 



If F(t) is a real process and a is a real valued r.v., 
the above equations reduce to the representation 
X(t) * K (t ) + Y (t ) where 
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• 2 2 2 
Y(t) = J (a cos 2ffXt+2frA sin 2 7r\t/a + 4 rr X )u(dX) + 

0 

* 05 2 2 2 

+ J (a sin 2v\t - 2uXcos 2frAt /a + 4 n X )v(dX) 

0 


00 


CO 


where F(t) = J cos 27rXt u (dX) + J sin 2?rAt v (d A) is the 
0 0 

spectral representation of F.* Also then E(Y(s)Y(t>) = 

“ 2 2 2 

J E(l/4ff X +a )cos 2irX(s-t)G(dX) and Y(t) is again stationary 
0 

2 2 2 

with correlation function f (r) = j E(l/4ir X +a )cos 2irXTG(dX) . 


0 


We get 

K (t) = e ta [Xq- a J Cu (dA)/a 2 +4ff 2 A 2 ) + J(2ctA v (dX)/ a 2 +4ff 2 A^) 


and so if a(co) > x. > 0 for almost all w , we see that 

lim K(t,oi) = 0 a.e. and then X(t) is asymptotically stationary 

t-CO 

(independent of the initial conditions). See also Adomian’s 

discussion of a similar problem in his dissertation. 

We now need to investigate carefully the various 

integrations involved in the above calculations. In particular, 

the problem may be phrased as follows: let I and J be 

2 

intervals, f:R x — > C measurable on the product space 

R x R x £ a random orthogonal measure; 1) can we define 


1 


See Doob [4] also. 



35 


the integral Jf (x, y , oo) £(dx) in a consistent way?, 2) if 
J 

so, when can we say that the interated integrals 

jj f (x,y, to) 4(dx)dy and jj f (x,y , w)dy4(dx) are equal? Let 
IJ JI 


us answer the first question. Let g:R x ft. — ■> C be a function 
with the property that there exists a mutually disjoint 
sequence of bounded Bor el sets fA k } k= -^ and a sequence 

2 n 
tg k ) k=1 > S k € L (ft), such that g(x, ce) = I C (A k> x)g k < oi) 

k 1 


where C(A^x) is the characteristic function of the set 
A^. Moreover we will require that the families (g k ) and 
(4(A fc ) } be independent. Then define Jg(x, ai) £(dx) = 


I g k (to) 4 (A., to) . We get 
k=l 

E( | Jg(x, to) £(dx) | 2 ) = E( I g.g, 4 (A.) 4(A k >) = 

j,k=l 3 k 3 K 

(3) = r_ - r E(|g k | 2 )M(A k ) 

j 7 k-1 k— 1 


= Je( | g(x) | 2 )M(dx) = J||g(x) Jj 2 M(dx) , 


where M is the absolute spectral measure associated with £■ 

Now consider the set J of all functions g(x, to) = 2C(A k ,x)g k (oi) 

where ig k } is independent of the family (4(A) ^€<7' ^ ~ all 

bounded Borel sets. J is clearly a linear space, and if g € J 

Jg(x)£(dx) is defined. Define ||g||^= ( J||g(x) J| 2 M(dx) ) 1,/2 , 

then || « ||^ is a norm on J. Complete J with respect to this 
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norm and denote the completed space S. If g € S and 
||g-g n [j^- — ■> 0, define Jg(x)£(dx) as the limit in the mean 
of the random variables Jg n (x) £(dx) . Note that equation (3) 
guarantees that this limit exists. Just as in the case 
of ordinary stochastic integrals with respect to orthogonal 
random measures, we have that g(x) is integrable whenever 
j/|g(x)j| M(dx) < °° and g is the limit of elements of J. Note 
that if g, h € S , then E( J*g(x) <-(dx) Jh(y)£(dy)) = 


= Jcov (g(x) , h (x) )M(dx) since the corresponding relation 
holds for elements of J. Note also that if g(x) is continuous 
in mean square and independent of (4(A) 3^^, then g is 
integrable if and only if j||g(x) || 2 M(dx) < 

Consider now the question of interchanging the order 

of iterated integrals. Suppose we have a function 

2 o 

f:R x C — •> C which is measurable, f(x,y,*) € L (ft) for 

each pair (x,y), and the natural map from R into L (ft) 

induced by f is continuous. Suppose also that the family 

tf (x,y) } (x j eR 2 of r.v.'s is independent of U(A)} A€ ^. 

Let I and J be intervals. Then g(x) = Jf(x,y)£(dy) exists 

I 

2 

if and only if Jj|f(x,y)|| M(dy) < ®. We want to integrate 

g (x ) over the interval J, and ||g(x)|| = (Je( |f (x,y) | 2 )M(dy) ) 1//2 

I 

so let us require that f satisfy the condition 


(4) J(J E( jf (x, y) | 2 )M(dy) ) 1//2 dx < “. 

J I 

Then the integral JJ f (x, y) 4(dy)dx exists. Now we want to 

JI 
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insure that Jj f (x, y)dx£(dy) exists, so we need to know 
IJ 

that J’ (E( !f (x,y) | 2 ) ) 1//2 dx < ®. Note that independence is 
J 

preserved under this integration, so all we need to check is 

that j E ( jh (y ) | 2 ) M (dy ) < 03 * where h(y) = J f(x,y)dx. But 
I ‘ J 

E(|h(y)| 2 ) = E jj f (s, y)f (t, y)ds dt = JJ E(f (s,y)f (t,y) )ds dt, 
JJ JJ 

so we require that f satisfy 

(5) JJJ E(f (s, y ) f (t, y ) )ds dt M(dy) < 05 . 

IJJ 

Now if f satisfies (4) and (5), both the iterated integrals 
exist. Consider now a subclass of function integrable with 
respect to £. We say that g € U if g € J and there is a sub- 

_ 2 

set H - H(g) C l (fi) whose finite linear combinations are 

2 

dense in L (fl) (call such a set linearly d ense) with the 
property that E(g(x)£(A)h) = E(g(x))E(£(A)h) for x 6 A, 

A € (7, h 6H(g). We sometimes write this relation as 

E(g(x) £(dx)tT) = E(g(x))E(£(dx)h) . If g is a simple function, 

then 

E(Jg(xU(dx)h) = E(E g k $<A k )h) = E E(g k )E(^(A k )h) = 

= J E(g(x) )M h (dx) 

for h 6H(g) where M h is the measure defined by M h (A) = E(^(A)h) . 
Hence if g 6 U, we have E(J g(x)£(dx)h) = J E(g(x) )M h (dx) for 
h £H(g). 

Return now to the consideration of our function f. We 
require now that the range of the function g:R — > J defined 
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by [g(x)](y,u>) = f(x,y,o?) be contained in U. Then there 

2 

is a linearly dense subset H C L^ft) such that if h £H 
then 

E(JJ f (x,y)dx£(dy)h) = J (E(J f (x, y)dx) )M. (dy) = 

IJ I J 

= JJ E(f (x,y) )dxM, (dy) = JJ E(f (x, y) )M. (dy)dx = 

IJ JI 

= J E(J f (x, y) £(dy)h)dx = E(JJ f (x , y ) £(dy ) dx h) . 

J I JI 

Since H is linearly dense and the above relation holds 
for all h €H, we conclude that 

(6) JJ f (x,y)£(dy)dx = JJ f (x, y)dx 4(dy ) 

IJ JI 

under these conditions. 

To summarize these results, we have the following 
theorem: 

Theorem 10 . Suppose f : R x R x fl — ■> C is; measurable and 

independent from the orthogo nal random measure £. Let M 

be the absolute measure associated with Let f (x, y , • ) 

be square integrable and continuous when considered as a 

2 

mapping from R x R into L (£■) . Suppose there is a 1 inear li 

2 — 
dense subset H of L (ft) such that E(f (x, y) £(dy )h) •= 

E(f (x,y) )E(4(dy)h) for h €H. Lf for the intervals I and J 

we have 

J (J E( |f (x,y) | 2 )M(dy)) 1//2 dx < 

J I 


(4) 


CO 
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(5) and JJJ E(f (x, y ) f (t , y)ds dt M(dy) < ® 

IJJ 

then f (x, y) £(dy)dx = f (x, y)dx 4 (dy) . 

IJ JI 

In our calculations involving the differential equation 
(1), the function f is defined by 

f (x,y, w) - e 2ffixy e ax = e 2xixy e a(w)x 

Suppose that K = ess sup la (to) I and a is real valued. Then 

to 

relation (4) becomes 

J (j E( |f (x, y) | 2 )M(dy) ) 1//2 dx = J (J E(e 2aX ) M(dy ) ) 1//2 dx 

O “CO 0 - 00 

(J M (dy ) ) 1/2 J E(e 2ax )dx. 

-CO O 

00 

But (J M(dy)) 1/2 = ||F(0)|| < and E(e 2ax ) < e 2Kx so 

— CD 

Ort y 

j E(e )dx < “ for t finite. Hence (4) holds. Consider 
0 

now relation (5) . 

|E(f (x,y)f (t,y)) | < E( le 2ffisy e as e" 2Trity e at j) < 

. K(s+t) 

_ e 

00 t t ^ 

hence |J J J E(f (s, y )f~(t' 7 y) )ds dt M(dy) 1 < 

O 0 

< ||F(0) || 2 J* J e K ^ u+v ^dudv < “ for t < °°. Since a is 
0 0 

independent of F, f is independent of 4 (being a Borel 
measurable function). Hence the only additional requirement 
we place on a and F is that there exist a linearly dense 


set H for which 
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E(e ya 4(dy)h) = E(e ya )E( £(dy)h) , 
for then we have 

E(f (x, y ) £(dy)h) = E(e 2ffixy e ya £(dy)h) = 

- e 2 » ixy E(e ya t<dy)h) - a 2nlIcy E(e ya )E(^dy)h)- 

- E(e 2ffixy e ya )E(£(dy)h) - E(f (x,y) )E( £<dy )h) . 

Note that if a is not random, then all these conditions are 
trivially satisfied. 

So now we can decompose the solution X(t) = K(t) + Y(t) 
into the sum of a stationary Y(t) and (in general) non- 
stationary K(t). Thus if we set K(t) - 0 and solve for Xq, 
we obtain a sufficient condition for stationarity . In 
particular, if 

(7) X Q - J* (l/2iriX+a)4(dX) 

then X (t ) is stationary. Note that a new difficulty arises 
in this expression. Namely, if a = 0 (in general, if 
ulaxaCoc) = 0} > 0) and 0 is in the point spectrum of F, then 
(7) is not defined. This does not contradict our exchange 
of integrations however, but it does say that we cannot 
split up the integral in equation (2). 

The condition in (7) may actually be a necessary 

o 

condition for stationarity. For example, consider the 
equation X’ (t) + X(t) - f, f €L 2 (ft). F(t) = f , so £(S) = f 
if 0 € S and £(S) = o otherwise. Hence the condition is 
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Xq = J(l./277iX+l) £(dX) = f and the resulting solution is 
X(t) = J(e 27ritX /2ffiX+l)<j(dX) = f. Note that F(t) is 
analytic, so solving by power series we get X(t) =f + (XQ-f)e * 
i^ e. , X ft = (-1 ) u (Xq- f), n > 1. Calculating the covariance 

function of this process, we see that a sufficient condition 

2 2 

that X(t) be stationary is that <f > = <fX^> = <Xq>. We 
show now that this is necessary. For if X(t) is stationary, 
<X Q X 2 > = -<X 2 >. But <X Q X 2 > = <X 2 > - <fX Q > and <X 2 > = 

<X 2 > - 2<fX Q > + <f 2 >. Also O = <X 0 X 1 > - <X 2 > - <fX Q >, i. e. , 

2 

<X Q > = <fX Q > anc * so we have 

O - <X 0 X 2 > + <X 2 > = 2<X^> - 3<fX Q > + <f 2 > = 

.= 2<X 2 > - 3<X 2 > + <f 2 >, i.e., <f 2 > = <X 2 >. 

Hence <X 2 > = <fX^> = <f 2 > is a necessary and sufficient 

2 

condition that X(t) be stationary. But then <(Xg-f) > = 

= <X 2 > - 2<fX Q > + <f 2 > = O and so f = X Q . Thus the condition 

Xq= J(l/2ffiX+l) £(dX) is actually necessary. (Note that 
we have incidentally proved that if a and b are r.v. 's, 
then a + be t is stationary if and only if b = 0). 

Of course the condition on X Q expressed by (7) is not 
always necessary for stationarity . Consider the following 
interesting example. Let X’(t) = F(t) and suppose that 
F(t) is real valued and analytic and 0 is not in the spectrum 
of F(t). Then the sufficient condition we get on Xq is 
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X n = -J (l/2irX)v(d\) 
u 0 

00 03 

where F(t) = f cos 2irtXu(dX) + J sin 2irtX v(dX). Note 

0 0 

CO 

that E(X F (t ) ) = - J (sin 2TrtX/2trX)M(dX) in this case. 

0 O 

If we calculate the coefficients in the power series 
expansion for F(t), we get 

CO 

F 0 - <-l) n f (2irX) 2n u(dX) 
in 0 

F 2n+ 1- <2”X) 2 “ +1 v(dX). 

00 

Hence in general we have <F 2 > = J (2irX) M(dX). Thus 

n o 

applying the result of example 1, we have that a necessary 
and sufficient condition for X(t) to be stationary is that 

<F(t)X 0 > = -2X (-l) n t 2n+1 / (2n+l) ) <F 2 > - 

= -r((-l) n t 2n+1 /(2n+l).')J'(2»rX) 2n M(dX) 

= -r J(-l) n ((2irtX) 2n+1 /(2n+l):2ffX)M(dX) 

= -J(sin 2fftX/2ffX) M(dX) . 

Thus we see that if X Q is any initial condition for which 

X(t) is stationary, then the projection of the r.v. X Q onto 

2 

the smallest closed linear manifold in L (H) containing 

03 

the process F(t) (call it is the r.v. -J (v (dX)/2TrX) . 

0 

Hence in the case of analyticity, a necessary and sufficient 
condition that X(t) be stationary is that 



43 


x rT Y - J* (v(dX)/2ffX) 
u 0 

where Y is any r.v. orthogonal to J. 

In this section we have restricted ourselves to the 
case of an equation with a constant (r.v.) coefficient. 

This restriction was made purely to facilitate the various 
computations made in the interchange of order of integrations. 
Examining the more general case (time-varying coefficients) 
the author has been unable to extract a likely candidate 
for the stationary part of the general solution. Neverthe- 
less, the idea of using random harmonic analysis especially 
in conjunction with the analytic method of section 2 appears 
valid, and progress in this direction seems likely in the 


future. 
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SECTION 4 

In section 2 we presented a general method of determin- 
ing when stochastic differential equations with random 
(analytic) coefficient processes, random (analytic) forcing 
function, and random initial conditions have stationary 
solutions. In section 3 we presented a method of applying 
random harmonic analysis to a simpler first order equation 
and we also presented an extension of integration techniques 
allowing us to use these more powerful tools. In this 
section we wish to relate our work to that done by others 
and to also make a few remarks concerning the abstract 
notion of stochastic transformations. We also indicate some 
future work. 

First let us relate our results to Adomian's [l] 
results concerning stochastic Green's functions transforming 
a given statistical measure of an input process to the 
corresponding measure of the output process. Suppose we 
have a stationary r.f. F(t) with spectral representation 

F(t) - J* e 2ffitX 4(dX). 

We have defined the correlation function 

f(t) = < F(s)F(s+t) > J e“ 2lTltX M(dX) 
where M is the absolute measure associated with £. Now if 
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M is absolutely continuous with respect to Lebesgue measure 
on the line, we call the Radon- Nikodym derivative 

m(x) = dM/dX 

the spectral density of the process F, i. , we have 

f(t) = J e~ 2ffltX m(X)dX 

and m(X) = J e 27rit ^f (t)dt 

Now in the equation discussed in section 3 

X’(t) + aX(t ) = F(t), X(0) = X Q 

with the r.v. coefficient a, we call F(t) the input process 
and X(t) the output process. Moreover, applying the results 
of section 2 we know that we can have a stationary F(t) 
resulting in a stationary X(t). Now let 

F(t) = J e 2ffitX ^(dX) 

and X(t) = J e 27TltX u(dX) 

be the spectral representations of F and X respectively. 
Suppose also that F has the correlation function f and 
spectral density function m. We calculated in section 2 
the correlation function x for X given by 

x(t) = J E(l/ |2 ff iX+a j 2 )e‘ 2,ritX m(X)dX. 

Hence we immediately recognize that the spectral density of 
X must be given by 

n(X) = E(l/|2ffiX+a| 2 )m(X). 
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Now the Green’s function transforming the spectral density 
of an input into the spectral density of the output is a 
(perhaps generalized) function H(t,u) such that 

n(t) = J H(t,u)m(u)du 

whereupon we see that H is given by 

(1) H(t , u) = 6(t-u)E(l/ |2ffiu+a | 2 ) 

Note that this form of the Green’s function is the same as 
Adomian's [1] if the r.v. a is a constant, for then we get 

H(t,u) = 6(t-u) |Y(u) | 2 

where Y(u) = l/(2ffiu+a). 

Similarly, the stochastic Green’s function G(t,u) trans- 
forming the correlation function f into x by the relation 

x ( t ) = J G(t,u)f(u)du 

can be expressed in terms of H by the relation 

G(t , u) = J7 e 2ffl(Tu-at) H(o, r)dodr 

and so applying (1) we get 

G(t,u) = J e 2ffit(u " t) E(l/ |2ffir+a l 2 )dT. 

In both cases we see that these Green's functions are ex- 
pressed in terms of the statistics of the coefficient in 
the stochastic differential operator. 

Let us make a few remarks concerning the idea of a 
stochastic transf ormation (s . t . ) , a concept due to Adomian 
[l]. If X(t,oi), t€T, cc € ft, is a s.p., a stochastic trans- 



47 


formation or stochastic operator T on X carries X into 
another process Z = T[X], and T in general depends on t 
and to' € SV (where £2' may not be identical to H) . Thus 
T includes all deterministic transformations as a special 
case and we usually deal with integral operators, differential 
operators, partial differential operators, etc . 

We wish now to indicate a general framework in which 
these ideas can be precisely expressed. In general there 
is a natural desire to distinguish between an operation of 
the form 

(2) X ( t , a)) = / H(t , u)Y (u, uddu 

where the kernel H(t,u) is a complex valued function and X 
and Y are r.f.'s and an operation of the form 

(3) X(t,uj) = J H(t,u, ui>Y(u, co)du 

where the kernel H also depends on the stochastic variable 
to. The transformation expressed by (2) in which the process 
Y is mapped into the process X is often called a deterministic 
transformation whereas (3) expresses an operation which 
includes (2) and conforms more closely with our intuitive 
notion of a stochastic transformation. Indeed (3) is the 
general form of a stochastic integral operator. Similarly 
an equation of the form 

(4) X ( t , oD = aY(t.w) + bZ(t, ui) 

where a and b are complex constants and X,Y, and Z are r.f.'s 
is rightfully considered a deterministic mapping of the 
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pair (Y,Z) into the process X. On the other hand, an 
equation 

(5) X ( t , to) = A(t, oi)Y(t, u) +. B(t, ui)Z(t, cd 

mapping the pair (Y,Z) into X is a "truly stochastic" 
operation. Also we need to consider maps of the form 
Y — > X defined by 

(6) X(t, «) - Y(f (t) , 03) 

where f:T — ■> T indicates a re-parameterization of the 
time variable. One wants to think of (6) as expressing 
a deterministic relationship whereas 

(7) X(t, oj) = Y(f (t),<p(o>)) 

where f:T — ■> T and <p:ft — > ft would again be- "truly 
stochastic". Bharucha-Reid 's [2] "random transformation" 
refers to a map 

(8) T: ft X R — > R 

with the property that the function T(*,x) is a r.v. for 
each x € R and such a random transformation may induce a 
stochastic transformation defined by 

(9) X(t, oi) = T(ui Y (t, ui) ) 

carrying Y into X. One would call such a transformation 
deterministic if the function T did not depend on the 
first coordinate of its argument. The examples of trans- 

i 

f 
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formations in the introduction to this thesis indicate more 

different forms that a s.t. can take. 

We propose to examine a function space approach of 

representing a r.f. as a measure on a fixed collection of 

functions; then a change of measures on this function space 

will be identified as a stochastic transformation. In 

particular, let X(t) be a real-valued s„p. with parameter 

set T = (a,b). Following the construction outlined in 

Skorokhod [10], we let $ be the space of all functions 

x: (a,b) — > R. If A is a Borel set in R and t^€ (a,b), 

we let C. (A) = [x € <3?:x(t„) € A}. A set which is the 
to 0 

intersection of a finite number of sets of the form C. (A) 

0 

is a cylindrical set . We let F be the minimal o-algebra 
of subsets of <J> generated by all cylindrical sets. Now the 
measure p determined on F by the relations 
k 

(10) rs C. (A ) ) = P[X(t. ,0J) € A., i = 1, . . . ,k} 

n=l n n 11 

for all k, t^,...,tk in (a,b) and all Borel sets A^,...,A^ 
is called the measure in the function space corresponding 
to the process X(t) . Kolmogorov's theorem guarantees us 
that (10) defines a unique measure on F. 

Conversely, suppose that we have a measure defined on 
F such that ji(4>) = 1. Then we have a probability space 
(R,^ - , P) where R = 7 = F, and P = n and so we can ,4&£ti ne a 

i 1 

process X(t), t € (a,b) by the relation 

i 

X(|t, ui) = X(t,x) = x ( t ) 
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We remark that X(t,*) is measurable, for let A be a Borel 
set. Then {«X(t,ui) € A } = [x:x(t) £ A} and this is a 
cylindrical set and so X(t,-> is measurable, i. e. , 

X(t) is a s.p. Note also that the function space measure 
corresponding to X is just p. 

Hence every process on (a,b) is associated with a 
measure on $ and conversely. Now let M be the set of all 
measures p on $ such that p(&) = 1. Then any function 
f:D — > M where D C m could be called a stochastic trans- 
formation. More generally, a function f :D — > M where 
D C M n can be a stochastic transformation. 

The above interpretation of a stochastic process as 
a measure on an appropriate function space does not in 
itself obviate any computational difficulties associated 
with the analysis of s.p. 's. However, we can now use the 
full power of general measure theory to gain new insight. 

For instance, the author is currently attempting to 
prove theorems answering the following questions: Let F 

be a stochastic transformation and let X(t) be a stationary 
(in some sense) process. Suppose that Y = F(x) is stationary 
(in the same sense). Let p and v be the measures associated 
with X and Y respectively. Let M be the manifold in 

X 

2 

L (fi) generated by X. Let Z = Z(t) be the process obtained 
by projecting Y onto M and let tj be the measure associated 

A 

with Z. Is v « p? Is r) « p? If v = v Q + is the 
Lebesgue decomposition of v with respect to p, does 
Tj = Vj7 If not, is r) « or « r}? Theorems along 
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these lines would give information concerning stochastic 
transformations which carry stationary processes into 
stationary processes. Also we naturally ask what effect 
on a measure associated with a s.p. is induced by a 
stochastic differential operator on the process. Also using 
our interpretation of s.t. 's in this way, perhaps we can 
discover measure- theoretic properties of ’’deterministic’' 
transformations (equations (2), (4), (6)) that distinguish 
them from ’’truly stochastic” transformations ((3), (5), (7)) 
and thus allow us to give a more useful and precise inter- 
pretation of these notions. 
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PROPOSED RESEARCH ON NUMERICAL METHODS 
FOR STOCHASTIC DIFFERENTIAL EQUATIONS 

Introduction 

Stochastic differential equations involving stochastic 
processes in the initial conditions, forcing functions, and 
even in the coefficients of the differential operator have 
been extensively studied, (see, e.g., ref. 11), the latter 
particularly by Adomian (see ref., 2, 3, 4, 5). As is the case 
with deterministic differential equations, numerical methods 
often become necessary for the solution of specific problems 
so it is of interest to develop numerical methods which 
insure correct statistic to first or second order. As an 
initial example we will consider the first order* stochastic 
differential equation 

Y ' (t) + £ (t) y (t) = ip (t) 

where £ (t) and iMt) are uncorrelated stochastic processes. 

This equation has been investigated by Adomian and Tikhonov 
(see ref. 2 in chapter 4) and by Astrom and others more 
recently. In Adomian' s work theoretical expressions were 
derived for the covariance of the solution process y(t). 

We now consider methods to calculate y(t) and Cov^(t,t') 
numerically . Two methods have been developed and computer 
programs have been written to implement the various algorithms 
The first method uses quadrature to evaluate the appropriate 

* 

We emphasize that the method is not for the solution of 
first order equations but is to be extended to partial differ- 
ential equations and nonlinear stochastic equations. The 
preliminary work is for checking against known results. 
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integral of the stochastic Green's function, {ref. 4,5). The 
second method simulates realizations of £ (t) and ip (t) from 
which the corresponding realization of y(t) is then computed. 

In this manner an ensemble of realizations of y(t) is calculated 
and statistically evaluated to approximate y (t) and CoVy(t,t'). 
The development of both methods has been for Gaussian 
£ (t) and (Mt) • There has been no indication that either method 
would not be useful if the stochastic processes are not taken 
to be Gaussian. 



where it is assumed that y Q and 5(t) are independent and that 
£(t) and ijj(t) are independent. With the same assumptions 
the product y(t) y(t') can be calculated and correlation 
functions E{y(t) y(t')} can be written 
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}E{i{>(u) Mv)}dudv ( 4 ; 


+E{ y< 


' 7 


t' 


E{e c 


-ft -ft' 

J §(x)dx J, g(x)dx 


v 


}E{^ (v) }dv 


+ E{ y 0 } 


t t' 

~l K (x)dx £ (x)dx 

E{e }e{iJj (u) }du 


"J ' 1 

+E{Yq} E{c a 


t’ 


-r 

K (x) dx J 5 (x) dx 


} 


For a Gaussian random variable z, 

2 

„ z -z-i -m 7 + 1/2 a 
Eie } = e z ' z 

. 2 

where rn is the mean of z and o is the variance of z. 
z z 

Defining the function 


(5) 


2(t, t ' , u,v) = m + 1/2 a 

z z 


( 6 ) 


where z '= 


t t * 

= j 5<x)dx + j K 
J XX '■'V 


(x)dx equation, (3) can be expressed 


E{y (t) } = f c S(t,0,u,0) E{iJj (u) }du + y Q e 2 <t,0,a,0) 


(7) 


and (4) can be written 
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E(y(t) y(t') } = 



t 


e ^(t,t f u # v ) E {^ ( u ) t|i (v) }dudv 


( 8 ) 



e 2 (t, t ' ,a, v) 


E{^ (v) } dv 





’ U,a) E(*(u) }du} 


+ Yq (t, t ’ , a,a) 

The covariances can be computed from (7) and (8) 

Cov y (t,t') = E{y{t) y(t’) } -E{y (t) } E{y(t')} (9) 

Inspection of (7) and (8) show that double and single 

integration must be performed if these equations are to be 

evaluated. Moreover, a vector of values, {yTtTJT, y ( 1 2 ) , . . ., 

y{t n )} must be evaluated to numerically represent y (t) and a 

matrix of values must be evaluated, Cov (t., t.) to represent 

Y 1 D 

Cov The amount of calculation required to evaluate 

this matrix and vector in any given case, made it necessary to 
give special attention to one and two dimensional quadrature. 
Gaussian quadrature, while more powerful in many respects, 
lacks one feature of Newton-Cotes quadrature that degrades 
its sophistication. With Newton-Cotes quadrature, but not 
with Gaussian quadrature, the integrand may be computed at 
new points while retaining the old values and then all values 
may be used to re-evaluate the integral. Moreover, this can 
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be accomplished without large core requirements for the com- 
puter. The only limiting factor on the particular Newton-Cotes 
formula (closed type) that may be used is the word size of 
the computer being used. 

[1] gives the 2-point through the 11-point Newton-Cotes 
formula (closed type) . A program was written for the FORMAC 
preprocessor for the PL1 language that will derive this type 
formula. This program has been used to compute the 12 -point 
through the 32-point formula. Higher formula have not 
been derived because formula higher than the 2 9 -point formula 
have weights that can not be expressed exactly on any machine 
available. The 3-point rule (Simpson's rule) through the 29- 
point formula have been written into a 3 subroutine program 
that permits the user to choose any formula desired, 3-point 
through 2 9 -point. Successive refinements of the interval of 
integration permit a predetermined accuracy to be selected. It 
must be noted that there is no mathematical guarantee that the 
selected accuracy will be achieved. Experience has shown that 
the convergence criterion employed is reliable for a large class 
of functions to either achieve the accuracy requested or to 
note failure. The subroutine package, named INTGL, will 



( 10 ) 


( 11 ) 
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INTGL was modified to use particular properties of (8) and (9) 
to decrease computation further. 

Program S DEQUAD was written to evaluate an approximating 
vector to y ( tjT and an approximating matrix to Cov^(t,t'). 

Quadrature is achieved by the modified INTGL package. The 
user of SDEQUAD must provide the interval of integration, 
initial mean and 2nd moment of y, the mean and covariance 
functions of £ and ^ and the function z . 

Advantages of this method include accuracy of the results 
and computation time requirements as compared to the simulation 
method. It is anticipated that this method can be applied 
to stochastic differential equations of higher degree provided 
that the stochastic Green's function can be calculated for 
the appropriate statistical measure to be evaluated, (see 
ref. 2-5) . Additional programming is necessary to accomplish 
this, however, and quadrature may become overly time consuming 
for given integrals. 

Three areas present themselves for further investigation. 
First, SDEQUAD may be used as a tool in its present form for 
analysis of specific cases of equation (1) . The function z, 
may be evaluated for £ that are not Gaussian. Second, a 
modification of SDEQUAD should be developed for a suitable 
class of 2 degree stochastic differential equations. According 
to references 2 and 5, stochastic Sturm-Liouville systems are 
subject to this approach. Consequently, a large class of 
problems of applied mathematics, engineering and sciences 
can be analyzed by stochastic methods. Third, partial differential 
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equations may also be approached by transformation into an 
integral equation. Equations of this type include meteoro- 
logical models involving a system of partial differential 
equations from the mechanics of continua (ref. 8). This system 
subject to stochastic analysis, should yield significant 
improvement in weather prediction. 

The Simulation Method 
Equation (1) can also be written 

y' (t) = <Mt> - £ (t) y (t) 

and this is the form in which Adomian does his iteration. 
Deterministic equations that are represented in this form may 
be solved numerically by Runge-Kutta methods [1] . By letting 
w represent a realization event in the probability space and 
writing 

*:<*> - * u (t > - yjt) 

the realization y^(t) can be solved numerically provided that 
the realizations £ (t) and ip (t) are known. The first task 
in developing a simulation of (2) was to simulate realization 
of a stochastic process x in terms of its statistical measures. 
In general, this depends upon the evaluation of the conditional 
distribution of 

X I X (ij.) — > X ) “ x 2 ' • • • * X = x i— 1 


( 12 ) 


( 13 ) 


( 14 ) 
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If X, = x(t,.)r i = 1, 2, . .., n and f (X ,X- , . . . ,X. ) is the 
joint distribution density function of {X^, X^r . ..,X^} then 
the conditional distribution density function can be written 

fy( x il x i =: x i' X 2 = x 2' ***' X i-1 = x i-l^ = 


00 OO 


/"•/ 

—00 — / — oo 


f (x.^ / X 2 f ♦ • • f 1 f ' • • • 9 x n ) ' * * * 9 


1 


CO 00 

...r 


f (X-^ X 2 r • • • / f / ♦ ♦ * f X^) f • • ■ f dX n 


~oo >y— 00 


If x(t) is a Gaussian stochastic process, then 


n 

I 


n 


e-V2 ±:i r i 1 MWW 


f (x , ..., x n )« 


n 


(2II) 2 (|M|) 


1/2 


where M is a n x. n matrix such that 


(M) . . = Cov {t. , t.) 

'13 X 1 r 

w. . = (M" 1 ) . . 

ID JO 


and 


*i - Xtty 


Let IYL denote the upper left i x i partition of M 

Let R^ denote the right-hand column of M^; R^ is the column 


vector whose elements are r^, , ... r^_^, r^, 


(15) 


(16) 
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Let P i 1 


r . so that P . = 1/r . . 

JL 11 


Equation (13) can now be written 


( 17 ) 


f x (x il x i “ x i' “*' x i-l “ x i-l J “ ( 2JII V 1/2 exp {-(X 1 -b 1 ) 2 /2P i > 


i - 1 

where b. = a. -P. £ r.(x. -a.) 

1 1 x j = i 3 3 3 


The value b^ is the conditional expectation of and P^ is 
the conditional variance of X^. The iteration to simulate a 
relationship of x(t) is defined by x^ = P^vk + b^ where 
{vu,y 0 , . .., y } are independently chosen values of a Gaussian 
random variable with zero mean and unit variance. The iteration 
is started by P^ = [M] ^ and b^ = a^ . An ensemble of realiza- 
tion of x generated in this manner approximate x in that the 
means and covariances of the realizations approximate xTtTT 

and Cov (t. ,t.), 1 < i, j < n. 
x l d 

With the ability to generate realizations of a stochastic 
process, our ability to solve stochastic differential equations 
is limited only by our ability to solve deterministic differ- 
ential equations. Linear equations of higher degree as well 
as non-linear equations are subject to the simulation approach. 
The class of stochastic differential equations that can be 
solved by this method is larger than the class that can be 
solved by the quadrature method. Two disadvantages of simulation 
in general also apply to stochastic simulation. Accuracy is 
limited. It is difficult to achieve more than 2 digits accuracy 
Simulation is also by nature time consuming. In many cases, 
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however, either method will yield results or the accuracy that 
can be reasonably achieved by a simulation is acceptable. 

Three areas for further investigation were mentioned with 
respect to the quadrature method. The same may be said with 
respect to simulation. 



REFERENCES 


1 . 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 

10 . 


Abramowitz, M. and Stegun, D. A. (eds.). Handbook of 
Mathematical Functions with Formulas s Graphs, and Mathe- 
matical Tables . Washington, D. C. : U. S. Government 

Printing Office, National Bureau of Standards Applied 
Mathematics Series, 1964. 

Adomian, G. "Linear Stochastic Operators," Ph.D. 
Dissertation. University of California (Los Angeles) , 

1961. 


, "Linear Stochastic Operators," Review of 

MoJerh Physics, vol. 35, (1963), pp. 185-207. (Not 

the same as ref. 2). 

r "Stochastic Green's Functions,” in ref. 

5 , pp. 1-39. 


, "Linear Random Operator Equations in 

Mathematical Physics," Journal of Mathematical Physics, 

vol. 11, no. 3, (March 1970), pp. 1069-1084. 

Bellman, R. (ed.) . Stochastic Processes in Mathematical 
Physics and Engineering . Proceedings of Symposium in 
Applied Mathematics , vol. 16. Providence, Rhode Island: 
American Mathematical Society, 1964. 

Bharucha-Reid, A. T. , "On the Theory of Random Equations," 
in ref. 5, pp. 40-69. 

Kibel,.D. A. An Introduction to Hydro dynamical Methods 
of Short Period Weather Forecasting . New York, N. Y. : 

The MacMillan Company, 1963. 

Miller, Kenneth S. Multidimensional Gaussian Distributions . 
New York, N. Y. : John Wiley and Sons, Inc. 1964. 

Saatz, Thomas L. (ed.) . Modern Nonlinear Equations . 

New York, N. Y. : McGraw-Hill Book Company, 1967. 

Syski, R. , "Stochastic Differential Equations," in ref. 9, 
pp. 346-456. 


11 . 



